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1.  EXECUTIVE  SUMMARY. 


1.1  Problem  Statement. 

The  reliability  growth  of  a  complex  system  involves  surfacing  and  analyzing  failure 
modes  and  implementing  corrective  actions,  (termed  fixes)  during  or  following  a  developmental 
test  phase.  At  the  end  of  a  test  phase,  program  management  usually  desires  an  assessment  of  the 
system’s  reliability  associated  with  the  current  configuration.  Such  an  assessment  can  be  derived 
from  failure  data  observed  in  the  test  phase,  and  assessments  of  the  corrective  actions  to  failure 
modes  surfaced  during  the  test  period.  Such  assessments  of  system  reliability  have  been  referred 
to  as  projections.  Current  projection  methods  distinguish  between  failure  modes  that  will  be 
addressed  by  a  fix  if  observed  (termed  B-modes)  and  those  that  will  not  be  fixed  (A-modes).  The 
estimate  of  current  system  reliability  depends  upon  this  mode  classification.  In  particular, 
estimates  of  the  rate  of  occurrence  of  B-modes  based  on  B-mode  first  occurrence  times  and  of 
the  presumed  constant  A-mode  failure  rate  are  required  to  assess  system  reliability.  It  would 
seem  desirable  and  more  natural  to  base  the  projection  of  system  reliability  on  estimates  that  do 
not  depend  on  such  a  classification  scheme,  but  merely  on  failure  mode  test  phase  data  and  the 
assessed  effectiveness  of  the  failure  mode  corrective  actions.  Such  a  projection  would  only 
distinguish  between  failure  modes  on  the  basis  of  their  assigned  fix  effectiveness  factors  (the 
expected  fraction  reductions  in  the  failure  mode  rates  of  occurrence  due  to  corrective  actions). 
Modes  currently  not  included  in  planned  or  realized  corrective  actions  would  be  assigned  a  zero 
fix  effectiveness  factor.  For  situations  where  fixes  to  surfaced  failure  modes  will  be  delayed  until 
the  conclusion  of  the  test  phase,  such  a  projection  method  would  be  helpful  in  conducting  a 
reliability  versus  cost  tradeoff  analysis  with  regard  to  deciding  which  modes  to  fix.  In  this  paper 
a  projection  method  is  presented  that  can  treat  failure  modes  in  such  a  unified  manner  for  the 
case  where  all  corrective  actions  are  delayed  until  the  end  of  the  test  phase.  Also,  the  estimation 
procedure  will  be  shown  to  be  closely  related  to  a  Stein  estimator  that  satisfies  an  expected 
squared-error  loss  optimality  criterion  for  estimating  a  vector  composed  of  the  unknown  mode 
initial  failure  rates. 

1.2  Overview. 

Assessment  methods  are  presented  for  projecting  the  impact  of  corrective  actions,  or 
fixes,  on  system  reliability.  The  presented  approach  to  reliability  projection,  referred  to  as 
AMPM-Stein,  addresses  the  case  where  all  fixes  are  delayed  to  the  end  of  the  current  test  phase. 
The  assessment  procedure  allows  for  a  unified  treatment  of  failure  modes.  The  procedure  when 
applied  in  this  fashion  only  distinguishes  for  estimation  purposes  between  modes  for  which  a  fix 
would  be  attempted  if  surfaced  (B-modes),  and  those  that  would  not  be  addressed  with  a  fix  even 
if  surfaced  (A-modes),  through  assigned  positive  and  zero  fix  effectiveness  factors  for  surfaced 
B-modes  and  A-modes,  respectively.  A  projection  procedure  that  can  treat  failure  modes  in  such 
a  unified  manner  is  necessary  in  cases  where  it  is  not  realistic  to  divide  the  potential  failure 
modes  into  an  inherent  set  of  A-modes  and  B-modes.  In  many  instances  A-modes  are  not 
inherent.  Modes  could  be  reclassified  from  A  to  B  due  to  repeat  occurrences  and  the  necessity  of 
meeting  a  reliability  requirement,  additional  information,  or  changes  in  the  level  of  resources 
available  for  corrective  action.  A  unified  treatment  also  lends  itself  to  performing  trade-off 
analyses  between  reliability  improvement  and  the  associated  corrective  action  implementation 
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costs.  The  AMPM-Stein  procedure  can  also  be  applied  to  the  case  addressed  by  widely  used 
projection  methods  for  which  there  is  an  assumed  inherent  division  between  potential  failure 
modes  with  respect  to  A-mode/B-mode  categorization. 

1.3  Features  of  AMPM-Stein. 

The  model  allows  for  a  unified  treatment  of  failure  modes.  This  permits  one  to  conduct  a 
trade-off  analysis  between  reliability  improvement  and  incremental  cost  since  failure  modes  are 
only  distinguished  through  their  FEFs.  A  second  feature  of  AMPM-Stein  is  that  all  failure  data 
is  utilized  in  estimating  model  parameters.  Third,  the  new  model  only  needs  to  assess  FEFs 
associated  with  the  surfaced  modes  -  there  is  no  need  to  consider  FEFs  for  unsurfaced  modes. 
In  particular,  AMPM-Stein  does  not  have  to  assess  an  average  FEF  for  all  the  modes  that  would 
receive  corrective  action  if  surfaced.  Finally,  AMPM-Stein  avoids  inaccuracies  in  assessments 
that  can  arise  in  projection  methods  which  utilize  A-mode  and  B-mode  classification.  Such 
inaccuracies  can  occur  if  modes  initially  considered  A-modes  are  switched  to  B-modes.  Modes 
can  be  reclassified  for  a  variety  of  reasons.  A  few  reasons  include  a  numerous  repetition  of  A- 
mode  failures,  a  more  accurate  diagnosis  of  a  failure  mode,  and  increased  funding. 

1.4  Results. 

Current  simulation  results  indicate  greater  accuracy  with  regard  to  the  MTBF  estimates 
can  be  achieved  by  the  AMPM-Stein  approach  even  when  an  A-mode/B-mode  split  is  valid.  In 
particular,  these  simulation  results  indicate  that  the  AMPM-Stein  MTBF  projections  obtained  for 
this  case  tend  to  be  more  accurate  than  those  obtained  from  the  reliability  projection  method 
adopted  as  a  standard  by  the  International  Electrotechnical  Commission,  namely  the  AMSAA- 
Crow  model.  Also  the  simulations  indicate  that  the  AMPM-Stein  MTBF  assessments  based  on 
the  simple  closed  form  parameter  estimators  obtained  from  the  method  of  moments  are  almost  as 
accurate  as  the  AMPM-Stein  assessments  that  utilize  the  more  computationally  intensive 
maximum  likelihood  estimators.  The  AMPM-Stein  approach  has  several  additional  appealing 
characteristics.  In  contrast  to  current  projection  methods,  the  approach  precludes  the  need  to 
assess  the  arithmetic  average  of  the  fix  effectiveness  factor  values  that  would  be  realized  if  all  B- 
modes  were  to  be  surfaced.  It  only  requires  assessment  of  FEFs  for  the  surfaced  modes  that  will 
be  mitigated.  In  addition,  the  AMPM-Stein  approach  naturally  leads  to  an  expression  for  the 
portion  of  the  mitigated  system  failure  rate  due  to  the  unsurfaced  modes  (or  unsurfaced  B-modes 
for  two  classifications).  Thus  no  functional  form  for  this  failure  rate  need  be  assumed. 
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2.  INTRODUCTION. 


2.1  Reliability  Growth  Terminology. 

Initial  prototypes  of  complex  systems  incorporating  new,  and  often  unproven, 
technological  advances  will  inevitably  possess  reliability  defects.  The  same  is  true  even  for 
prototypes  that  consist  of  the  integration  of  existing  systems.  These  known,  and  often  unknown, 
defects  are  identified  and  examined  in  developmental  and  operational  testing  of  the  system,  and 
are  referred  to  as  failure  modes.  Failure  modes  are  the  root  causes  of  potential  reliability 
deficiencies  in  a  system.  Failure  modes  are  typically  unforeseen  problems,  and  have  associated 
failure  mechanisms.  Corrective  actions,  or  fixes,  are  measures  which  are  taken  to  address  these 
problem  failure  modes.  More  specifically,  corrective  actions  alter  the  design,  maintenance, 
operational  procedures,  or  the  manufacturing  process  of  an  item  for  the  purpose  of  improving  its 
reliability.  To  model  the  reliability  improvement  resulting  from  a  corrective  action,  we  use  Fix 
Effectiveness  Factors  (FEFs).  A  fix  effectiveness  factor  (FEF)  is  the  expected  fraction  reduction 
in  initial  mode  failure  rate  due  to  corrective  action.  Corrective  actions  are  typically  reserved  for 
failure  modes  which  exhibit  one  or  more  failures  during  testing,  which  are  referred  to  as  surfaced 
modes,  or  observed  modes.  Unsurfaced  modes,  or  unobserved  modes,  are  failure  modes  which 
did  not  trigger  a  failure  during  the  test  phase.  Of  particular  interest,  is  the  time  of  first  failure  for 
a  given  mode,  which  is  referred  to  as  the  First  Occurrence  Time  (FOT).  In  addition,  mode 
failures  beyond  the  FOT  are  referred  to  as  repeats. 

Clearly,  this  categorization  of  surfaced  and  unsurfaced  modes  is  based  on  the  perspective 
of  the  mode  failure  pattern;  that  is,  either  the  mode  exhibits  a  failure  or  it  does  not.  Failure 
modes  are  also  categorized  from  a  reliability  improvement  point-of-view;  that  is,  either  a 
corrective  measure  will  be  taken  to  address  a  reliability  deficiency,  or  it  will  not.  This  leads  to 
two  types  of  failure  modes,  namely  B-modes  and  A-modes.  B-mode  failures  are  the  set  of  all 
failure  modes  for  which  a  corrective  action  would  be  implemented  if  the  mode  is  surfaced.  The 
remaining  failure  modes,  the  set  of  all  unsurfaced  and  surfaced  modes  where  corrective  measures 
are  not  pursued,  are  referred  to  as  A-mode  failures.  There  are  a  number  of  reasons  why  some 
surfaced  modes  are  classified  as  A-modes.  A  few  of  these  reasons  include,  the  fix  may  not  be 
economically  justifiable,  the  surfaced  mode  may  be  related  to  Government  Furnished  Equipment 
(GFE),  or  a  Commercial-Off- The-Shelf  (COTS)  item  (whose  failure  rate  is  known  or  accepted), 
or  the  diagnosis  of  the  underlying  failure  mechanism  may  be  unclear. 

2.2  Areas  of  Reliability  Growth. 

To  uncover  and  mitigate  potential  reliability  deficiencies,  early  prototypes  and  later  more 
mature  units  are  subjected  to  a  series  of  developmental  and  operational  tests.  The  tests  are 
specifically  designed  to  expose  the  system  to  the  envelope  of  stresses  and  operating  conditions 
that  are  expected  to  be  experienced  during  the  weapon’s  life  cycle.  Encountered  failures  are 
analyzed,  corrective  actions  are  implemented,  and  modifications  to  the  system  design,  and 
manufacturing  process,  are  tested  to  verify  the  effectiveness  of  the  corrective  actions.  The 
resulting  reliability  maturation  process  is  commonly  referred  to  as  a  Reliability  Growth  Program 
(RGP).  Reliability  Growth  Management  (RGM)  of  this  program  is  the  systematic  planning  for 
reliability  achievement  as  a  function  of  time  and  other  resources,  as  well  as  controlling  ongoing 
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rates  of  achievement  by  reallocation  of  resources  based  on  comparisons  between  planned  and 
assessed  reliability  values  (MIL-HDBK-189,  1981).  RGM  procedures  are  utilized  in  guiding  the 
materiel  acquisition  process  for  new  military  systems.  These  include:  reliability  growth 
planning,  reliability  growth  tracking,  and  projecting  reliability  improvements  for  a  system. 
Reliability  growth  planning  addresses  program  schedules,  amount  of  testing,  available  resources, 
and  the  realism  of  the  test  program  in  achieving  its  requirements.  Reliability  growth  tracking  is  a 
process  which  allows  management  the  opportunity  to  gauge  the  progress  of  the  reliability  effort 
of  a  system.  This  is  done  by  evaluating  a  demonstrated  numerical  measure  of  the  system 
reliability  during  a  RGP  based  on  test  data.  Reliability  growth  projection  is  the  process  of 
assessing  the  reliability  of  a  system  which  can  be  anticipated  due  to  implementation  of  corrective 
actions  to  failure  modes.  Reliability  projections  are  based  on  the  test  data  to  date,  as  well  as 
engineering  assessments  of  the  effectiveness  of  planned  or  implemented  corrective  actions. 
Reliability  growth  projection  is  the  focus  of  the  presented  analysis. 

2.3  A  Brief  History  of  Reliability  Growth  Projection. 

The  genesis  of  reliability  growth  projection  has  its  roots  in  a  paper  written  by  Corcoran, 
et  al.  (1964).  The  paper  presents  a  nonparametric  Discrete  Reliability  Growth  Model  (DRGM) 
for  which  the  relevant  data  comprise  sequences  of  dichotomous  success-failure  outcomes.  The 
model  attempts  to  quantify  the  increase  in  system  reliability  attained  after  implementing 
corrective  actions,  without  the  benefit  of  continued  testing.  Here,  N  items  are  tested,  and  S  items 
are  observed  to  have  performed  successfully.  The  modes  associated  with  the  remaining  N-S 
failures  are  identified  and  subsequent  corrective  actions  are  performed.  No  follow-on  tests  are 
performed.  However,  the  nominal  reliability  estimate  is  adjusted  to  reflect  the  reliability 
improvement  obtained  via  the  fixes.  The  update  to  the  nominal  reliability  estimate  is  the 
reliability  projection  following  corrective  actions. 

Another  milestone  in  the  area  of  reliability  growth  projection  includes  the  development  of 
Continuous  Reliability  Growth  Models  (CRGMs).  CRGMs  are  models  utilized  in  representing 
the  reliability  growth  of  a  system  in  the  case  where  the  test  duration  is  measured  on  a  continuous 
scale  (i.e.  time  or  distance),  as  opposed  to  a  discrete  one  (i.e.  trials  or  rounds)  as  discussed  above. 
The  first  model  appears  in  a  paper  written  by  Crow  (1982).  This  model,  the  AMSAA-Crow 
model,  projects  a  system’s  failure  intensity  at  the  beginning  of  a  follow-on  test  phase,  based  on 
reliability  data  captured  from  the  previous  test.  These  data  include,  the  B-mode  FOTs,  the 
number  of  failures  associated  with  each  B-mode  failure,  and  the  total  number  of  failures  due  to 
failure  modes  that  will  not  be  addressed  by  corrective  actions,  namely  the  A  modes.  In  addition, 
the  reliability  projection,  per  the  AMSAA-Crow  model,  uses  engineering  assessments  of  the 
planned  fixes  to  B-modes  surfaced  during  the  test.  The  estimation  procedure  assumes  that  all 
fixes  are  deferred  until  the  end  of  the  current  test  phase,  but  are  implemented  prior  to  the  follow- 
on  test.  The  model  also  assumes  each  failure  causes  a  system  failure  and  that  the  number  of  B- 
modes  that  occur  by  a  given  test  duration  can  be  modeled  by  a  Poisson  process.  The  AMSAA- 
Crow  model  is  internationally  recognized  as  being  the  standard  reliability  growth  projection 
model  per  the  International  Electrotechnical  Commission  (IEC  61164,  2004). 

Another  projection  model,  termed  the  AMSAA  Maturity  Projection  Model  (AMPM),  was 
introduced  by  Ellner,  et  al.  (1995).  Like  the  AMSAA-Crow  model,  the  AMPM  applies  to  the 
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case  where  the  test  duration  is  measured  in  a  continuous  fashion,  such  as  in  hours  or  miles.  In 
contrast  to  the  AMSAA-Crow  projection  model,  the  AMPM  does  not  require  that  all  the 
corrective  actions  be  implemented  at  the  end  of  the  test  phase.  Therefore,  one  may  use  the 
model  to  calculate  a  reliability  projection  in  the  case  where  not  all  fixes  are  delayed,  or  in  the 
case  where  all  fixes  are  delayed.  The  AMPM  can  also  be  utilized  to  calculate  a  projection  for 
milestones  beyond  the  start  of  the  next  test  phase.  This  is  a  flexible  feature  in  that  the  model  can 
make  projections  beyond  the  range  of  the  data,  whereas  the  AMSAA-Crow  model  should  only 
be  used  to  calculate  projections  up  to,  or  at,  the  end  of  the  test  phase.  Finally,  there  are  five  main 
assumptions  implicit  in  using  the  AMPM.  The  first  assumption  is  that  there  are  k  failure  modes, 
where  k  is  large.  Second,  each  failure  mode  time  to  first  occurrence  is  assumed  to  follow  the 
exponential  distribution.  The  third  assumption  is  that  the  occurrence  of  failures  due  to  modes  are 
statistically  independent.  The  fourth  assumption  is  that  each  failure  mode  occurrence  causes 
system  failure.  Lastly,  the  initial  B-mode  failure  rates  are  assumed  to  be  a  realization  of  a 
random  sample  from  a  gamma  distribution. 

2.4  The  International  Electrotechnical  Commission. 

The  EEC  is  a  worldwide  organization  for  standardization  comprising  all  national 
electrotechnical  committees  (i.e.  IEC  National  Committees).  The  objective  of  the  EEC  is  to 
promote  international  co-operation  on  all  questions  concerning  standardization  in  the  electrical 
and  electronic  fields.  In  addition  to  other  activities,  the  EEC  publishes  international  standards. 
The  preparation  of  these  standards  is  entrusted  to  technical  committees;  any  IEC  National 
Committee  interested  in  the  associated  subject  may  participate.  International,  governmental  and 
non-governmental  organizations  liaising  with  the  EEC  also  participate  in  this  preparatory  work. 
The  EEC  collaborates  closely  with  the  International  Organization  for  Standardization  (ISO)  in 
accordance  with  conditions  determined  by  agreement  between  the  two  organizations.  The 
formal  agreements  of  the  IEC  on  technical  matters  express,  as  nearly  as  possible,  an  international 
consensus  of  opinion  on  relevant  subjects,  since  each  technical  committee  has  representation 
from  all  interested  national  committees.  IEC  documents  have  the  form  of  recommendations  for 
international  use  and  are  published  in  the  form  of  standards,  technical  specifications,  technical 
reports  or  guides. 

2.5  Role  of  Mode  Classification  in  Current  Models. 

As  discussed,  the  reliability  growth  of  a  complex  system  involves  surfacing  and 
analyzing  failure  modes,  and  implementing  corrective  actions,  termed  fixes,  during  or  following 
a  developmental  test  phase.  At  the  end  of  a  test  phase,  program  management  usually  desires  an 
assessment  of  the  system’s  reliability  associated  with  the  current  configuration.  Such 
assessments  of  system  reliability  have  been  referred  to  as  projections.  Current  projection 
methods  distinguish  between  failure  modes  that  will  be  addressed  by  a  fix  if  observed  (B-modes) 
and  those  that  will  not  be  fixed  (A-modes).  The  estimate  of  current  system  reliability  depends 
upon  this  failure  mode  classification.  In  particular,  the  reliability  projection  depends  on 
estimates  of  the  rate  of  occurrence  of  B-modes  based  on  B-mode  first  occurrence  times,  and  of 
the  presumed  constant  A-mode  failure  rate  required  to  assess  system  reliability.  It  is  desirable 
and  more  natural  to  base  the  projection  of  system  reliability  on  estimates  that  do  not  depend  on 
such  a  classification  scheme,  but  merely  on  failure  mode  test  phase  data,  and  the  assessed 
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effectiveness  of  the  failure  mode  corrective  actions.  Such  a  projection  would  only  distinguish 
between  failure  modes  on  the  basis  of  their  assigned  FEF.  Here,  A-modes  would  be  assigned  a 
zero  FEF.  For  situations  where  fixes  to  surfaced  failure  modes  will  be  delayed  until  the 
conclusion  of  the  test  phase,  such  a  projection  method  would  be  helpful  in  conducting  a 
reliability  versus  cost  tradeoff  analysis  with  regard  to  deciding  which  modes  to  fix. 

2.6  Study  Overview. 

In  this  paper  we  shall  present  a  projection  method  that  can  treat  failure  modes  in  a  unified 
manner  for  the  case  where  all  corrective  actions  are  delayed  until  the  end  of  the  test  phase.  A 
unique  characteristic  of  the  projection  methodology  is  that  the  estimation  procedure  is  based  on  a 
Stein  shrinkage  estimator.  For  a  large  number  of  potential  modes,  the  estimation  procedure  is 
shown  to  approximate  a  Stein  estimator  that  satisfies  an  optimal  expected  squared-error  loss 
criterion  for  the  vector  of  unknown  initial  mode  failure  rates.  The  Stein  optimality  criterion 
leads  to  a  particular  functional  form  for  the  rate  of  occurrence  of  new  failure  modes.  This 
functional  form  is  compared  to  the  B-mode  rate  of  occurrence  functions  currently  utilized  in 
several  projection  models.  The  procedure  does  not  require  one  to  distinguish  between  failure 
modes  that  will  not  be  corrected  if  surfaced  (A-Modes)  and  those  that  would  receive  a  corrective 
action  if  observed  (B-Modes).  Such  a  unified  treatment  of  failure  modes  avoids  the  frequently 
unrealistic  assumption  that  there  are  two  distinct  types  of  potential  failure  modes  a  priori.  Often 
failure  modes  are  switched  from  A-Modes  to  B-Modes  during  a  development  program  due  to  the 
necessity  of  meeting  a  requirement  or  due  to  additional  funding  or  information  that  allows  a 
mode  to  be  addressed.  Several  estimation  procedures  are  presented  for  assessing  the  Stein 
shrinkage  factor  utilized  by  the  reliability  projection  method.  The  accuracy  of  the  presented 
projection  procedures  is  compared  against  the  IEC  standard  projection  model,  namely  the 
AMSAA  Crow-Model.  The  test  data  and  projections  are  simulated.  The  simulations  results  are 
compiled  over  1,000  replications. 

2.7  The  AMPM  based  on  Stein  Estimation. 

The  U.S.  Army  Materiel  Systems  Analysis  Activity  (AMSAA)  has  recently  developed  a 
new  reliability  growth  projection  model.  The  new  model  is  closely  related  to  the  current 
AMPM.  This  new  model  was  developed  for  making  reliability  projections  based  on  Stein 
estimation  of  initial  mode  failure  rates  in  the  case  where  the  test  duration  is  measured  in  a 
continuous  fashion,  and  where  all  corrective  actions  are  deferred  until  the  end  of  the  test  phase. 
The  motivation  for  developing  the  new  model  was  to  calculate  a  potentially  more  accurate 
reliability  projection,  that  was  based  on  the  FEFs  and  number  of  failures  for  the  observed  failure 
modes.  This  is  done  by  approximating  an  estimator  that  minimizes  the  expected  squared  error  in 
the  initial  mode  failure  rates.  Estimates  for  unknown  parameters  in  the  Stein  approach  are 
obtained  by  treating  the  initial  mode  failure  rates  as  a  realization  of  a  random  sample  from  a 
gamma  distribution  as  is  done  in  the  AMPM  approach.  Thus,  the  new  model  is  referred  to  as 
AMPM-Stein. 

2.8  Features  of  AMPM-Stein. 
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The  model  allows  for  a  unified  treatment  of  failure  modes.  This  permits  one  to  conduct  a 
trade-off  analysis  between  reliability  improvement  and  incremental  cost  since  failure  modes  are 
only  distinguished  through  their  FEFs.  A  second  feature  of  AMPM-Stein  is  that  all  failure  data 
is  utilized  in  estimating  model  parameters.  Third,  the  new  model  only  needs  to  assess  FEFs 
associated  with  the  surfaced  modes  -  there  is  no  need  to  consider  FEFs  for  unsurfaced  modes. 
In  particular,  AMPM-Stein  does  not  have  to  assess  an  average  FEF  for  all  the  modes  that  would 
receive  corrective  action  if  surfaced.  Finally,  AMPM-Stein  avoids  inaccuracies  in  assessments 
that  can  arise  in  projection  methods  which  utilize  A-mode  and  B-mode  classification.  Such 
inaccuracies  can  occur  if  modes  initially  considered  A-modes  are  switched  to  B-modes.  Modes 
can  be  reclassified  for  a  variety  of  reasons.  A  few  reasons  include  a  numerous  repetition  of  A- 
mode  failures,  a  more  accurate  diagnosis  of  a  failure  mode,  and  increased  funding. 

2.9  Mathematica. 

The  simulation  for  this  study,  as  well  as  Section  4  of  this  report,  are  written  in  a 
Mathematica  notebook.  Mathematica  is  a  software  tool  that  integrates  a  programming  language, 
numeric  and  computational  engine,  graphics  system,  and  documentation  system,  as  well  as, 
provides  advanced  connectivity  to  other  applications  such  as  Microsoft  Excel.  Throughout 
Section  4,  the  documentation,  graphing  and  programming  are  seamlessly  integrated.  Sections  of 
text  in  bold  represent  code  that  will  be  executed  by  Mathematica's  computational  engine.  The 
output  (i.e.  numbers,  lists,  tables,  graphs,  figures  etc.),  if  any,  from  the  executed  code  will  appear 
immediately  below  the  code,  or  program  instructions. 
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3.  COMPARISON  OF  AMPM-STEIN  AND  CURRENT  MODELS. 


3.1  Differences  in  Technical  Approach. 


The  AMPM-Stein  approach  does  not  require  one  to  distinguish  between  A-modes  and  B- 
modes  other  than  through  the  assignment  of  a  zero,  and  positive  FEF,  respectively,  to  surfaced 
modes.  Also,  only  FEFs  associated  with  the  surfaced  modes  need  be  referenced.  In  particular, 
unlike  the  methods  in  Crow  (1982)  and  Ellner,  et  al.  (1995),  no  estimate  of  the  arithmetic 
average  of  all  the  FEFs,  that  would  be  realized  if  all  the  B-modes  were  surfaced,  is  required. 
Another  significant  difference  between  the  Stein  approach  and  the  other  methods  is  that  the  Stein 
projection  is  a  direct  assessment  of  the  realized  system  failure  rate  after  failure  mode  mitigation. 
The  approaches  (Crow,  1982),  (Corcoran,  et  al.,  1964),  and  (Ellner,  et  al.,  1995)  indirectly 
attempt  to  assess  the  realized  system  reliability  by  estimating  the  expected  value  of  the  mitigated 
system  probability  of  failure  or  system  failure  rate,  r(T),  where  r(T)  is  viewed  as  a  random 
variable.  For  example,  in  Crow  (1982)  and  Ellner,  et  al.  (1995)  ,  the  realized  value  of  r(T)  is 
assessed  as  the  estimate  of  a  conditional  (given  ),  or  unconditional  expected  value  of  r(T) , 
respectively,  where, 
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Corcoran,  et  al.  (1964)  proceeds  in  a  similar  fashion  for  one-shot  systems.  In  Crow  (1982)  it  is 
shown  that, 
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To  estimate  E\r(T)\,  the  AMSAA-Crow  method  approximates  ■Xi  -e'^by  Md  •Xve";"T 
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where  d *  is  an  assessment  of  d ; .  The  sum  IX  • e'A,T  is  estimated  (Crow,  1982)  by  noting  that 
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the  number  of  B-modes  surfaced  by  t  is 
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and  the  expected  number  of  B-modes  by  t,  is 
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Thus,  the  slope  of  ju(t)  is 
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and  represents  the  expected  rate  of  occurrence  of  B-modes  at  t.  By  assuming  ju(t)  can  be 
approximated  by 

//«(<)  =  K  -Tfl  (8) 

and  that  M(t)  is  a  Poisson  process  with  mean  value  function  Xc  -tPc ,  Crow  (1982)  develops  an 
estimation  procedure  for  Xc  and  j3c  based  on  the  B-mode  first  occurrence  times  and  number  of 
surfaced  B-modes.  This  yields  an  estimate  of 

Pc  ',A  1  (9) 

at 

which  represents  the  rate  of  occurrence  of  new  B-modes  at  time  t  for  the  AMSAA-Crow  model. 
The  resulting  estimate  of  hc(t),  hc(t),  is  taken  as  an  assessment  of  ^T/l,  ■  e~x,T  ,  and  pd  • hc(t )  is 

ieB 

utilized  as  an  assessment  of  V  di  ■  Xi  •  e~l'T  .  The  assessment  for  E[r(T)\  (Crow,  1982),  and 

ieB 

hence  the  indirect  assessment  of  the  realized  value  of  r(T ) ,  is  then  obtained  as 

^(01  =  ^+  2  (1  -  of  ^  -  4  (2")  (10) 

t  ieobs(B)  V  -*  / 


The  AMPM  approach  (Ellner  et  al.,  1995)  treats  the  initial  B-mode  failure  rates  Xt  as  a 
realized  random  sample  of  size  kB  from  a  gamma  random  variable,  F[«,/?] ,  with  density 

\  xa-eX/p 


/W  =  jr(a  +  l)-y9a+1  (11) 

0  x<0 

where  T  is  the  gamma  function,  a>- 1  and  j5>  0.  The  AMPM  approach  replaces  T  with 
t  >  T  and  the  in  equation  (2)  by  independent  and  identically  distributed  random  variables 
A(.  ~r[a,/?].  The  expected  value  of  E[r{t)\  with  respect  to  A,,...,Atfi  is  obtained  as 

p{t)  =  XA+(l-jud  ){XB  -  h(t ))  +  h{t)  (12) 

where 

V/Ha+l)  (13) 

(l  +  yff-0 

A  A 

and  XB  =  h( 0) .  Maximum  likelihood  estimates  for  XS,J3  and  a  ,  denoted  by  XBkg  ,j3kg  and  akg 
respectively,  are  obtained  based  on  kB  ,  the  number  of  surfaced  B-modes,  and  the  observed  B- 
mode  first  occurrence  times.  The  realization  of  the  mitigated  system  failure  rate,  r(t),  is 
assessed  as  the  resulting  estimate,  pke(t),  of  p(t) .  The  limiting  values  of  ,j3kg ,  and  ak 
are  obtained  and  used  to  derive  px  (t)  =  lim  pk  (t) .  This  limiting  estimate  is  taken  as  the 

ks-xv  B 

assessment  of  the  realized  value  of  r(t )  for  complex  systems  (i.e.  for  large  kB  ).  The  use  of  B- 
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mode  first  occurrence  times  to  estimate  and  a  allows  the  AMPM  approach  (Ellner,  et  al., 
1995)  to  be  used  to  assess  the  realized  value  of  r(t)  for  t>T  .  One  need  only  assume  that  all 
fixes  are  incorporated  by  t.  In  particular,  it  is  not  necessary  to  assume  that  all  fixes  are  delayed 
until  t.  Note,  however,  the  AMPM  and  AMSAA-Crow  methods  both  require  an  assessment  of 
Hd ,  the  arithmetic  average  of  the  B-mode  FEFs  that  would  be  realized  if  all  B-modes  were 

surfaced.  Also,  both  these  methods  utilize  the  number  of  observed  B-modes  and  the  B-mode 
first  occurrence  times  for  parameter  estimation  to  obtain  an  assessment  of  the  realized  mitigated 
system  failure  rate.  Thus  these  methods  do  not  solely  distinguish  between  A-modes  and 
surfaced  B-modes  for  estimation  purposes  by  assigning  zero  FEFs  to  the  former  and  positive 
FEFs  to  the  latter. 


Finally,  we  note  a  connection  between  the  AMPM  estimate  for  h(t )  and  the  Stein 
projection.  It  is  shown  that  h(t)  is  the  expected  failure  rate  due  to  the  B-modes  not  surfaced  by  t 
(Ellner  et  al.,  1995).  As  suggested  by  equation  (13)  the  AMPM  estimate  based  on  kB  potential 
B-modes  is 


It  is  shown  in  Ellner,  et  al.  (1995)  that 


(1  +  fikB-tf‘+2 


U0  =  Hm  hkB  (0  =  -V- 
(1  +  &•/) 


(14) 


(15) 


where  XBa.  and  f3a  are  positive  constants.  For  t  =  T  this  form  will  be  shown  in  Section  3.4  to 

be  compatible  for  complex  systems  with  the  Stein  projection  expression  for  the  portion  of  the 
mitigated  system  failure  rate  attributable  to  the  B-modes  not  surfaced  by  T.  This  is  interesting  to 
note  since  the  Stein  projection  approach  does  not  treat  the  initial  B-mode  failure  rates  as  a 
realization  of  a  random  sample  from  some  assumed  parent  population. 


3.2  Stein  Approach  to  Projection  using  One  Classification. 

Assume  the  system  has  k  >  1  potential  failure  modes  that  have  initial  failure  rates 
It  is  assumed  the  modes  independently  generate  failures  and  that  the  system  fails 
whenever  a  failure  mode  occurs.  It  is  also  assumed  that  corrective  actions  do  not  spawn  new 
failure  modes  and  that  all  fixes  are  incorporated  into  the  system  at  the  end  of  a  test  period  of 
duration  T  hours,  or  miles. 


Let  N'.  denote  the  number  of  failures  encountered  for  mode  i  that  occur  during  the  test. 
The  standard  Maximum  Likelihood  Estimate  (MLE)  of  A.;  is 

-  N. 

(16). 

Let  avg(Xi )  denote  the  arithmetic  average  of  the  estimates  X],...,Xk .  The  Stein  estimators  for 
AI,...,Ak ,  denoted  by  Al,...,Ak ,  are  defined  by 
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A  =  0  •  A,  +  (1  -  0)  ■  avg(Xt )  (17) 

where  <9  e  [0,1]  is  chosen  to  minimize  the  expected  sum  of  mean  squared  errors, 

k  ^ 

E  -/l,)2  •  We  shall  let  6S  denote  the  optimal  value  of  0  and  refer  to  6S  as  the  Stein 

.  i=i  J 

shrinkage  factor.  Vector  estimators,  such  as  of  multidimensional  parameters  that 

satisfy  such  an  optimality  criterion  were  considered  by  Stein  (1981).  To  obtain  0S  note  the 
following: 

1  *  N-  N 

tL~ 


where 


From  (20)  we  have 
and 


kjjT  k-T 

*=5>, 

M 

E(Ni)  =  Ai-T  =  Var(Ni) 


Finally,  from  the  above,  one  can  show, 


Far[i,]  =  i 


K 

z* 


=  A 


and 


Var 


k 

LI 


X 

T 


Let 


^•Li 


1=1 


After  some  detailed  calculation,  using  equations  (14-20)  we  arrive  at  the  following  result 


;=i 


=  e2\ 


"A 

<T) 


f  A  > 


+  (l-0)22>2  +  20(1-9)  — —  +  (1-0) 

i=i  yk-i  y 


/£  A2 
k 


(18) 

(19) 

(20) 

(21) 

(22) 

(23) 

(24) 

(25) 

(26) 


Thus,  E 


£(V4): 


1=1 


is  a  quadratic  polynomial  with  respect  to  0 .  The  polynomial  coefficient 


of  02  is  equal  to 


'  x  x2^ 


i=i 


-  +  ■ 


k-T  k 


i-f) + 


1=1 
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i,_i 

n  k 


for  k  >  1 ,  where 


>0 

1=1 

(27) 

-  1 

A  =- 

k 

(28) 

The  quadratic  polynomial  with  respect  to  9  in  equation  (26)  has  a  unique  minimum  value  that 
can  be  found  by  solving  the  equation 

d(J _ 


—  eY^-Ai)2  =o 

do{  Ltr  JJ 

Denoting  the  unique  value  of  6  that  solves  equation  (29)  by  90,  we  find 

n  _ _ /fi _ 

0  2  (  \\  k 

Thus,  we  have  90  e  (0,1)  which  shows  that  9S  is  equal  to  90.  Let 


Var[X:\. 


Note  by  equation  (30), 


By  equation  (24),  we  can  see  that 


9S  =7 — - 
5  (  X 


k 

Var^) 


~~  1-7  +^1 

Lf  A  k) 


\±^=\±v°W 
K  1=1  -1  *  1=1 


Let  denote  the  right  side  of  equation  (33).  It  is  interesting  to  note  by  equation  (32) 

that 

o5= - m -  (34) 

avg{i'ar[i  ]|  1  +  Var[Z,  ] 

This  shows  that  the  Stein  estimate  of  Xi  can  be  expressed  as  the  following  weighted 
combination  of  Xs  and  avg(i(  ); 

T  f  1;  f  |  ,-v 

A  =  - 7  ■  .  7 — 7\  A  + -  ^7/  n  avw  (35) 

*MA  ]  +  avg(Kar[A  ]|l  -  - J  Kor[ A  ]  +  avg(Kar[ A  ]J  1  -  - J 

Therefore,  the  smaller  the  population  variance  of  the  mode  failure  rates  is  relative  to  the  average 
of  the  variances  associated  with  the  individual  mode  standard  estimators,  VarfAJ,  the  more  X{  is 
weighted  (i.e.  “shrunk”)  towards  avg{i , 
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After  mitigation  of  the  failure  modes  surfaced  during  the  test  period  [0,  T],  the  realized 
system  failure  rate  is 

+  (36) 

ieobs  . 

ieobs 

The  Stein  projection  for  r(T),  denoted  by  ps  (T)  is  obtained  by  replacing  dt  by  an  assessed 
value  d]  and  by  estimating  A{  by  At .  Thus, 

(37) 


Note  for  mode  i  e  obs  ,  by  definition  N{=  0 .  Thus,  by  equation  (17)  where  6  =  6S ,  we  obtain 


for  i  e  obs  , 


4  =(1-0) 


Let  m  denote  the  number  of  surfaced  modes  during  [0,  T].  Then  by  equations  (37)  and  (38), 

ps(j>L(  i—  a-»s)  £  (39) 

The  Stein  projection  cannot  be  directly  calculated  from  the  data  for  a  set  of  d *  since  k  is 
typically  unknown  before  and  after  the  test  and  6S  is  a  function  of  Var[/ 1.],  A,  and  k  (or 

k 

equivalently,  ,  A,  and  k).  However,  approximations  to  the  Stein  projection  can  be 

i=i 

obtained  that  can  be  calculated  from  the  test  data  and  the  assessed  FEFs. 

3.3  Stein  Approach  to  Projection  using  Two  Classifications. 

One  can  also  use  the  Stein  projection  approach  with  two  failure  mode  classifications  as  is 
done  for  the  AMSAA-Crow  and  AMPM  models.  Strictly  speaking,  such  an  application  of  these 
models  demands  that  there  are  a  priori  ground  rules  for  classifying  observed  modes  into  A  or  B- 
modes  which  do  not  become  reclassified.  The  Stein  projection  for  the  two  failure  mode 
classification  case  is  given  by 

p«(J>i,+  D(i-rf,‘H+  2A  (40) 


ieobs  (B) 


ieobs  (B) 


In  equation  (40)  Aa  denotes  the  collective  failure  rate  due  to  the  A-modes  and 

*  Na 

4.  (41) 

where  NA  is  the  number  of  observed  A-mode  failures.  Also,  obs(B)  denotes  the  index  set  of 

the  observed  B-modes  and  obs(B)  denotes  its  complement  in  B.  For  i  e  B ,  Ai2  denotes  the 
Stein  estimate  of  At  for  two  classifications.  In  place  of  the  expression  for  A-t  in  equation  (17) , 
Ai  2  is  defined  as 


13 


4  -4 +('-<4.)- 


14 


ieB 


(42) 


In  equation  (42),  A:B  is  the  number  of  potential  B-modes.  The  shrinkage  factor  6S  B  in  equation 


1(4, -4)! 


ieB 


(42)  is  the  value  of  6  e  [0,1]  that  minimizes  E 
derived  in  a  manner  similar  to  6S .  In  place  of  equation  (30), 

E(4-4)! 


This  optimal  value  for  9  is 


@s,b  ~ 


ieB 


1 


1-- 
V  kBj 


(43) 


ieB 


where 


4=fl4 


k  • 

kB  i*B 


(44) 


Finally,  we  note  that  the  Stein  projection  for  two  mode  classifications,  pS2(T) ,  can  be  expressed 
in  a  manner  analogous  to  equation  (39): 

PsaV)  = 

'n„ 


ieobs(B) 


(  m  4 
i  _  aii 

V  kB  J 


o-M 


In  equation  (45),  mB  denotes  the  number  of  surfaced  B-modes  and 

a'<=2>,=  2>, 

ieB  ieobs(B) 


(45) 


(46) 


3.4  Failure  Rate  due  to  Unobserved  Modes  as  k  . 


The  term  in  equation  (37)  represents  the  portion  of  the  projected  failure  rate 


ieobs 


ps(T)  attributed  to  the  failure  modes  not  surfaced  by  T.  Equation  (38)  indicates  that 


XT =o-^)o-— )| 

l€  obs 


( 


(47) 


W  J 


Utilizing  the  expression  (32)  for  6S  we  obtain 


6  A  V 


\-es  = 


k-Tj 


1 


1 

V  kj 


Var[Ai]  + 


f  AY.  1 


\k-Tj 


1  — 


k) 


(48) 


Thus, 


14 


(49) 


f  A  " 

k-T , 


1- 


lY.  mY 


ES  = 

ieobs  Var[Xt]  + 1 


kjCkJ 


w  y 


a  Y^r 

l  kj 


Using  equation  (31)  we  obtain, 


V- 


k-T 


k-T 

iY 


l- 


m 


vj\Y 


1- 

V  k  j 


vj  y 


ieobs 


f  k  02 

14 -7 

V  w  *  . 


+ 


r  a  y.  n 


(50) 


v^-ry 


1  k) 


or  equivalently, 


^iYi--!- 

*A  k XT , 


ieobs 


y  k 

i=i 

A 

A 

k 

V 

y 

(51) 


1--1  + 
l  k) 


To  consider  the  limiting  behavior  of  the  expression  in  equation  (51)  for  large  k,  denote  A,  by 
Xi  k  for  i  =  l,...,*  where 

2>a=A  (52) 

i=i 

and  Ag(0,oo)  with  k  >  1.  Let  A^(AliJt,...,Ai>,).  Consider  the  maximization  problem  P: 

(  1  k  \ 


max  | 

A 

—k 


subject  to  Aik  >  0  and  (52).  All  maximizers  A°  for  problem  P  are  of  the  form 

vY  i=i  y 

0  z  ^  / 


2° 

A,*  — 


A  /  =  / 


Thus  the  maximum  value  for  problem  P  equals 


a  1=1 


(53) 


(54) 
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This  shows  that  for  any  k  >  1  with  at  least  two  non-zero  Aa  one  has  0  <  —  <  A .  This 

implies  that  for  complex  systems  or  subsystems  (i.e.  for  large  k) 

YX,s-  A 

^  '  1 


1  +  Ps-T 

ieobs 


(55) 


where 


A  = 


A 


(56) 


and  0  <  /3S  <  A  with 
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Ps=\  i>;  (57) 

^  /=1 

Using  two  mode  classifications,  in  a  similar  fashion  one  can  show  that  for  complex  systems  or 
subsystems 


ieobs(B) 


+  Ps.b  •  T 


(58) 


where  AB  =  and  0  <  B  ,  where  PSB  =—  ^T/l,2  and  ^  2(.  . 

T  izB  ieB 


The  functional  form  in  equation  (58)  for  approximating  14  is  the  same  form 

ieobs(B) 

utilized  by  the  AMPM  model  for  large  k  to  estimate  the  failure  rate  due  to  the  unsurfaced  B- 
modes  at  the  end  of  the  test  period.  In  contrast  to  the  AMPM,  the  Stein  projection  approach 
leads  to  this  form  for  large  k  without  assuming  the  initial  B-mode  failure  rates  are  a  realization 
of  a  random  sample  from  an  assumed  parent  population.  The  AMSAA-Crow  projection 

estimates  the  failure  rate  at  the  end  of  test  due  to  the  unsurfaced  B-modes  by  Ac  •  ■  TPc~x ,  where 

Ac  and  Pc  are  statistical  estimates  of  Ac  and  pc .  This  functional  form  arises  from  the 
AMSAA-Crow  assumption  that  the  number  of  B-modes  that  are  surfaced  by  t  is  M(t )  where 
M(t)  is  a  Poisson  process  with  mean  value  function  Ac  -tPc  for  Ac  >  0  and  fic  >  0 . 


3.5  AMPM-Stein  Approximation  using  MLE. 


As  shown  in  the  previous  section,  the  Stein  projection  depends  on  the  unknown  constants 

k 

k,  A  =  '^Ai ,  and  VartAJ.  We  shall  now  consider  an  approximation  to  the  Stein  projection 

i=] 

obtained  for  a  given  k  and  for  when  k  is  unknown  but  large.  To  obtain  the  approximations  we 
assume  Al,...,Ak  is  a  realization  of  a  random  sample  from  a  gamma  distribution  with  density 

function  given  in  equation  (11).  We  shall  use  the  data  A,,  to  obtain  MLEs  for  a  and  /?, 

denoted  by  ak  and  /3k .  The  method  of  marginal  maximum  likelihood  will  be  employed  (Martz 
et  al.,  1982).  We  shall  initially  use  the  gamma  parameterization  used  in  Martz,  et  al.  (1982)  (i.e. 

a0=a+ 1  and  /?0  =  — ,  to  express  the  MLE  equations.  After  simplification  of  equations  (7.171) 


and  (7.172)  (Martz  et  ah,  1982),  we  arrive  at  equations  (59)  and  (60)  below, 


a0  =■ 


AT 

7=1 


*  (  Nj  ^ 


T  +  P0 


7=1 


T  +  Po 


(59) 


and 
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(60) 


*  NrV  i  A  * 

*-ln[/?0]  +  ££  t— :  -£ln[r  +  y50]  =  0 
j=\  i=i  v  ao  + 1 )  M 

Let  Xk  s  k  ■  Pk  (1  +  ak )  where  ak  and  fik  denote  the  MLEs  for  a  and  /? ,  respectively,  given  the 

1 

system  has  k  potential  failure  modes.  Thus,  ak  =a0-\  and  J3k  =  —  .  This  yields 

A 

f  k  \  - 

Xk  =  —  aa .  Equations  (59)  and  (60)  can  be  rewritten  in  terms  of  Xk  and  pk .  Upon 

V  A)  y 

simplification  we  obtain, 


N 


The  sum  from  i  =  1  to  Nj  - 1  in  equation  (62)  is  defined  to  be  zero  if  Nj  - 1 .  Next  we  consider 

A  /V  A  A  A  A 

the  limiting  values  of  Xk  and  fik  as  k  increases.  Let  Xm=\\mXk  and  /3X  s  lim  /?, .  From 

i->«>  oo 

equation  (61)  and  (62)  it  follows  that 


&-T 


ln[l  +  PK-T]  =  m 


One  can  show  that  equation  (64)  has  a  unique  positive  solution  J3X  if  and  only  if  N  >  m.  This 
condition  is  equivalent  to  saying  JV;  >  1  for  at  least  one  mode  i.  We  shall  assume  this  is  the  case. 

Consider  equation  (62)  and  let  xk  =  fik  -T .  Then  one  can  show  3  xk  e  (0 ,J3X  • T )  such  that  xk 
satisfies  (62)  provided 

N 2 

k  >  -  (65) 

Y(N,  -  wo 

jeobs 

From  numerical  experience,  we  conjecture  that  equation  (65)  is  a  necessary  and  sufficient 
condition  for  a  solution  xk  e  (0,y5x  -T)  of  equation  (62).  However  this  has  not  been  established. 
One  can  utilize  the  finite  k  estimate  pk  to  obtain  an  estimate  of  the  shrinkage  factor  6S .  The 
limiting  value  shall  be  used  to  estimate  6S  for  complex  systems  or  subsystems.  To  consider 
this  further,  let  T[a,/3 ]  denote  a  gamma  random  variable  with  density  f(x) .  Also  let  A,,...^ 
be  independent  and  identically  distributed  gamma  random  variables  with  density  / (x) ,  given  in 

k 

equation  (11).  Define  As^A;,  Note  E\r[a,f3~^  =  ft -{a  +  \)  and  Var\r[a,J3^  =  fi2 -(a  +  1) . 


This  implies  E[!\]  =  k- (3(a  +  \)  and  £[(A:-1)-52(A;)]  =  (k-Y)-fi2 -(a  +1)  where  s2(A()  = 

j  k  _  _  J  k 

- - V(A,-A)2  and  A  =  — A.  Thus  we  shall  approximate  X  =  by  k  ■  J3k  (ak  + 1)  =  Xk 

k- ly  k  ;=i 


Jfc-1 


and  k-Var[j l,.]  =  ^(A;-A)2  by  (k-X){j3k)2(ak  +1)=  —  -A*.  By  equation  (32), 

w  v  £  y 


5  ay.  n 


i— 


vy  A  *y 


(66) 


+  &  •  Fhr[A(] 


Thus  we  approximate  by 


^S,4  ~ 


Pk'T 


(67) 


l  +  A-7- 

This  suggests  that  for  complex  systems  or  subsystems,  (i.e.  large  k)  a  suitable  approximation  for 


es  is 


0S,.  =  Jim  0SJc  = 

A— >oo 


fi.-T 

1  +  k-r 


(68) 


One  can  now  obtain  approximations  to  the  Stein  projection  by  utilizing  8sk  and  8S  K . 

These  approximations  will  be  referred  to  as  the  finite  k  and  infinite  k  AMPM-Stein  projections, 
respectively.  For  finite  k,  motivated  by  equation  (17)  we  define 

4-4.,Ao (69) 

for  i-l,...,k.  The  corresponding  AMPM-Stein  projection  for  the  system  failure  rate  after 
mitigation  of  surfaced  modes,  denoted  by  pS  k  ( T ) ,  is  given  by 

a  +  (70) 

ieobs  .  — — 

ieobs 

Equation  (70)  can  be  rewritten  in  a  manner  analogous  to  the  form  of  equation  (39)  utilized  for 
the  Stein  projection: 

6  N_' 

v  T , 

We  also  obtain 

Ps„  (T)  =  Jim  p,  „  (J)  =  £(1  -  d]  )4, J,  +  (1  -  4 ,  )  Y 
The  corresponding  MTBF  projection  is 

A,.«(ps..(0)“  (73) 


(o  =  2  a  ■ - d'  A  +  o  -  -xi  ■ - . 4.,  )| 


ieobs 


(71) 


(72) 


One  can  also  apply  the  AMPM-Stein  projection  to  the  case  of  two  mode  classifications  based  on 
appropriate  a  priori  mode  classification  rules.  Denoting  the  two-mode  AMPM-Stein  system 
failure  rate  projections  by  pSXks( T)  and  Ps,i,.iT)  for  the  finite  and  infinite  kB  projection 
respectively,  we  let 
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and 


*■  ieobs(B) 


ps,-.i(n=^+  Zo-OU  +  o-4.,») 

■*  ieobs(B) 


',_a' 

K  J 


1(1  -est.JN‘' 


V  1  J 


fN^ 


V  T  j 


where  for  equations  (74)  and  (75), 


and 


X,kB  -@S,B,k„  '  X  +  0  @S,B,kB  WU;) 

i'e=B 


In  equations  (74)  and  (75),  respectively, 


and 


X  x  =  lim  X:  k 

kg-** o  a» 


<9 


S.S,** 


5 


1  +  ’T 

A.,  -r 


S,£,® 


(74) 

(75) 

(76) 

(77) 

(78) 

(79) 


i+Avr 

In  equation  (78)  is  the  MLE  solution  of  the  following  modification  of  equation  (62): 

kP  +  tt,]-  S  Z~"  7-~~~  T  s~g^  (8°) 

-  I  *  ’  Sk*  ‘  KB 


rN.' 


\yhJ 


jeobs(B)  i=l  j  y  kB 

N 


B  J 


In  equation  (80),  the  sum  from  i  =  1  to  i-  Nj  - 1  is  defined  to  be  zero  if  JV .  =  1 .  In  equation 

A  A  A 

(79),  J3b  m  is  the  limit  of  the  J3B  k ,  and  yx  =  J3B  a>  ■  T  satisfies  the  following  modification  of 
equation  (64) 


"N 


Ns 
X=  J 


ln[l  +  yJ  =  M* 


(81) 


For  equations  (80)  and  (81)  we  assume  NB  >  mB .  This  guarantees  equation  (81)  has  a  unique 
positive  solution,  yx .  If  in  addition, 


kD  > 


(NBy 


B  'ZiNj-VNj 

jeobs(B) 

(the  counterpart  of  equation  (65))  then  equation  (82)  will  have  a  solution  yk  e  (0,^) . 


(82) 


3.6  AMPM-Stein  Approximation  using  MME. 


Using  Method  of  Moment  Estimation  (MME)  a  second  estimation  procedure  was  utilized 
to  estimate  6S  and  obtain  associated  approximations  to  the  Stein  projection  for  the  mitigated 
system  failure  rate.  The  second  procedure  is  a  method  of  moments  presented  in  Section  7.7.1  of 
Martz,  et  al.  (1982).  Once  again  assume  that  Xl,...,Xk  is  a  realization  of  a  sample  of  size  k  from 
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Y{a,P).  It  is  noted  in  Chapter  7  of  Martz,  et  al.  (1982)  that  the  marginal  distribution  of  Nj  is 
given  by  the  density  g(nj,a0,j30 )  where 


g(nj,a0,fi0)  = 


r(aoynjHT  +  fi0)‘^ 

1 


(83) 


for  rij=  0,1,2,...  where  a0=a  +  \,  and  /?„=  —  anc*  nr  denotes  the  factorial  of  The 
marginal  mean  and  variance  are 


E[N„a0,M=a°T 


and 


Var[Nj,a0,j30]  = 


Po 

«o -T<T  +  Po) 


Po 


It  follows  that  the  marginal  mean  and  variance  of  X,  are 


On 


and 


E[Aj,a0M  =  ^ 
Po 

*  9  Po 


(84) 


(85) 


(86) 


(87) 


_  k  X-  k  X2 

Let  A  s  V—  and  m2u  =  V (the  unweighted  sample  mean  and  second  sample  moment  about 
w  k  Tf  k 

A  A 

the  origin  respectively  for  .  In  Martz,  et  al.  (1982)  it  is  shown  that 


an 


E[Au,a0,P0]  =  f 
Po 


and 


E[M],a0,P0]  = 


a0[T-(\  +  a0)  +  po\ 

T-Pl 


(88) 


(89) 


where  Au  and  M ]  are  random  variables  that  take  on  the  values  of  Au  and  m] ,  respectively. 
This  suggests  implicitly  defining  the  unweighted  moment  estimators  for  a0  and  /?0 ,  denoted  by 
a0  and  /?0 ,  respectively,  through  the  following  equations: 


and 


n  _a0 


m2  _a0[T-(l  +  a0)  +  fi0] 

T-Po 


(90) 


(91) 
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Let  ak  and  (3k  be  the  corresponding  method  of  moments  estimators  for  a  and  /?  based  on 


assuming  k  potential  failure  modes.  Thus,  ak  =a0- 1  and  J3k=-~-.  Let 

A) 

K  =k-pk  *(i+«*) 

From  equations  (90)  and  (91)  it  can  be  shown  that 


an 


k-X. 


K  k-(mu-Xu)-H-Xu 


(92) 

(93) 


where  H  =  — .  From  the  first  equality  in  equation  (93)  we  have 

an  1  +  ak 


Thus 


This  yields 


Also 


K  j=\ 

±Nf  N 
K=k.pk-{\  +  ak)  =  Y^  =  j 


r  k-(m2-X2u)-H-Xu 
Pk  k-X 


k  (  nA2  i 

from  the  second  equality  in  equation  (93).  Note,  k  ■  m2  =  ^ . X2  =  ]>] |  —  •  Also’ 

7=1  7=1 

_  1  '  ^ 

*-;i2  = 


(94) 


(95) 


(96) 


(97) 


r2 


jeobs 


k-T 2 

=-4- 

w  rp2 


IX 

jeobs  J 
(  \ 

y  yeo&s  J 


and 


Thus  by  equation  (97) 


-  ^  Ni 

jeobs 


(98) 

(99) 

(100) 


(  v 


JLy  n2 _ —  Yn.\  -—Yn. 

rp2  La  j  7,  rpl  ZjJV7  t2  La1'  7 


A  = 


T*  - 
J  yeo&s 


Jr.T*  I  7  I  T  r  ( 
^  *  y jeobs  J  ■*  jeobs 

y  Hi 

L~U  rp 

jeobs  ■* 


(101) 


This  yields. 
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Yn]-—-n 

~  ^  J  k 

n  _  jeobs  A' 

Pk~  T-N 


(102) 


One  can  now  obtain  the  method  of  moments  limit  estimators  Xm  and  f. 3m  as  k  increases.  These 


are  Xa  =  lim  Xk  and  J3X  =  lim  .  From  equation  (96), 

*— >co  A— >oo 

I 


Also,  from  equation  (102), 


/*.=■ 


2X2 

jeobs 

N 


2  ^ 


—  1 


(103) 


(104) 


The  moment  estimates  f3k  and  of  p  provide  the  respective  estimates  6S  k  and  6S  m  of  the 
Stein  shrinkage  factor  0S ,  where 

Pk-T 


and 


@S,k  ~ 


1  +  Pk'T 

P„'T 


(105) 


(106) 


1  +  P„-T 

The  moment  estimators  of  6S  in  equations  (105)  and  (106)  provide  corresponding 
approximations  to  the  Stein  system  failure  rate  projection.  Let  pSk(T )  and  pSx(T)  denote 

these  approximations  based  on  6S  k  and  6S  m,  respectively.  In  place  of  equation  (71)  for  the 
MLE  based  approximation  of  ps  ( T )  we  define 


Ps,k  ~  + 


ieobs 


f  m"' 

_ _ , 

1  — 

(1-^) 

l  k ) 

(107) 


Kk s  osA  +  0  -  es.k  )^vg(^ ) 


(108) 


where,  for  equation  (107), 

Let, 

Ms,k(T)^{pSk(T)Y  (109) 

denote  the  corresponding  AMPM-Stein  MTBF  projection  based  on  the  finite  k  moment 
estimators  for  9S .  Next,  let 

Ps,oo(^)  =  }imps,*(r)  (110) 

x— >co 

1  . 

Note,  \\mavg{Xp  =  lim—  >  Ai  =  0.  Also  0Soo=lim#5A.  by  equations  (105)  and  (106), 

*->O0  *  — >CG  lr  ^  Ir-^rr. 

#V  ieobs 


respectively.  Thus  by  equation  (108)  \\mXik=6Sa 

*— >co 


*->  CO 

r  Njj 


.  By  equation  (107)  this  yields 
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Ps,.  =  +O-0S.J  V  (HI) 

The  corresponding  MTBF  projection  is 

MSi.(D«fe,„(r)p  (112) 

AMPM-Stein  projections  based  on  moment  estimators  can  also  be  developed  for  the  case  where 
failure  modes  are  partitioned  into  A-modes  and  B-modes  by  a  priori  classification  rules.  The 
shrinkage  factor,  finite  kB  approximation  to  0S  B  is  given  by 

PBk  ■ T 

n  _  r /i  i 


(113) 


The  estimate  fiB  k  in  equation  (1 12)  is 


Iwj-ffk-* 


__  jeobs(B)  \ 


Thus, 


pB,ke  ~ 


Pb, co  s  li ™Ps,kB  = 


nf  ZV 


jeobs(B)  ^ 


T  Nc 


(114) 


(115) 


The  corresponding  large  kB  estimate  of  0S  B,  based  on  the  limit  of  the  method  of  moments 
estimator  PB  kg ,  is 

6Boo-T 

e^-Tk-r  _  _  (U6) 

The  AMPM-Stein  system  failure  rate  projections,  based  on  dS  B  ks  and  6SBoo  when  utilizing  two 
mode  classifications  are  denoted  by  ps  2  ke  (T)  and  pSXm  (T)  >  respectively.  In  place  of  equation 
(107)  for  psk{T)  we  have 


Ps,u, cn=^t-+  Zo-OL.  + 


For  equation  (113), 


The  MTBF  projection  is 


\lkB  —  @S,B,kB  k  +  (1  @S,B,kB  )  avs(^i  ) 


Let  p. ,  ( T )  s  lim  pS2k  ( T ) .  Then  we  can  show  that 

“  ’  ’  B 

N  ~  ( N  ~ 

A.2,(0  =  -r+  Z 

■*  *e0i>s(2?)  \  / 


The  associated  MTBF  projection  is 


Ms,2,AT)  =  (p>s,2,ST)Y 


(117) 


(118) 


(119) 


(120) 


(121) 
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3.7  Cost  versus  Reliability  Tradeoff  Analysis. 


At  the  end  of  a  test  phase  one  might  wish  to  conduct  a  cost  versus  reliability  tradeoff 
analysis  to  assist  in  selecting  a  set  of  surfaced  failure  modes  to  address  with  fixes.  For  any 
selected  set  of  surfaced  modes,  say  Z  c  obs ,  one  could  study  the  underlying  root  causes  of 
failure  to  determine  potential  fixes.  Based  on  such  a  study,  a  set  of  positive  FEFs,  d *  for  i  e  Z 
could  be  assessed  for  the  proposed  fixes.  Actual  implementation  of  these  fixes  would  lower  the 

k 

system  failure  rate  from  the  initial  value,  say  p(T;<f>)  =  ,  to  a  lower  failure  rate 

1=1 

p(7-;Z)  =  £(1 +  2^+E1.  022) 

ieZ  ie(obs-Z)  . 

teobs 

with  corresponding  MTBF  M(T-,Z)  =  (p{T-,Z))~x .  Note  that  p(T;Z)  changes  from  p(T;<f>)  as  a 
function  of  the  selected  mode  set  Z  only  through  the  FEFs  being  raised  from  zero  to  positive 
values  dl  for  ie  Z  .  The  assessments  for  p(T;Z)  provided  by  the  AMPM-Stein  approach  have 
the  same  property.  For  example,  this  can  be  seen  for  the  AMPM-Stein  system  failure  rate 
assessment  for  large  k  based  on  MLEs  by  recalling  equation  (72).  Since  d’  =  0  for 


ie(obs-Z)  we  have 


ps..  (T) = 2(>  -  <  AJ,  *  E k J, + (i  -  k.  i 

ie(obs-Z) 


ieZ 


( N' 
KT; 


(123) 


N 

where  Z,.  =  .  Note  by  equations  (68)  and  (64),  0S  tc  only  depends  on  N  and  the  number  of 

surfaced  modes,  m.  Thus  by  equation  (123),  ps<x>(T )  is  an  assessment  of  p{T\Z)  that  only 

changes  for  a  given  set  of  test  results  as  Z  changes  through  the  resulting  change  in  the  FEFs. 
However,  assessments  of  p{T\Z)  based  on  the  AMSAA-Crow  (Crow,  1982)  or  AMPM  (Ellner 
et  al.,  1995)  would  not  change  solely  due  to  the  change  in  FEFs  brought  about  by  a  change  in  Z. 
In  these  methods  the  modes  are  partitioned  into  A-modes  and  B-modes.  If  one  identifies  the 
modes  in  Z  as  the  surfaced  B-modes  (since  d]  >0  for  ieZ )  then  these  assessments  would 
depend  on  the  number  of  modes  in  Z  and  the  pattern  of  first  occurrence  times  for  these  modes,  in 
addition  to  the  assessed  FEFs  for  ie  Z  .  The  dependence  of  the  assessment  of  p(T;Z)  on  the  B- 
mode  first  occurrence  times  indicates  that  the  AMSAA-Crow  and  the  version  of  the  AMPM 
based  on  B-mode  first  occurrence  times  are  not  appropriate  for  this  selection  problem. 


Associated  with  each  selection  of  Z,  one  could  also  assess  the  cost  of  implementing  all 
the  fixes  for  the  failure  modes  ieZ  .  Let  c  {Z )  denote  this  assessed  cost.  A  plot  of  the  points 

[m s^(T\Z),c  (Z))  where  MSm(T;Z)=  (ps M(T;Z))~]  for  a  number  of  potential  selected  sets  Z 
would  be  useful  in  identifying  the  least  cost  solution  Z  to  meet  a  reliability  goal.  Alternately, 
one  could  replace  M Sx(T;Z)  by  the  AMPM-Stein  assessments  of  MTBF  based  on  the  method 
of  moments  estimators. 
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4.  SIMULATION. 


4.1  Simulation  Overview. 

One  replication  of  the  simulation  is  demonstrated  in  this  section  of  the  report.  The  simulation 
results  in  this  section  do  not  support  any  conclusions,  since  they  merely  represent  one  execu¬ 
tion  of  the  model.  The  simulation  results  shown  in  Section  5  are  obtained  from  1,000  replica¬ 
tions  of  the  simulation,  and  provide  the  data  supporting  the  presented  conclusions.  The  pur¬ 
pose  for  this  section  is  to  document,  and  demonstrate  the  inner  workings  of  the  simulation.  In 
Section  4.2,  data  typical  to  that  which  would  be  collected  in  a  developmental  test  is  generated. 
This  includes  obtaining  necessary  inputs,  generating  failure  rates,  first  occurrence  times,  fix 
effectiveness  factors  and  failure  times.  Also,  data  structures  are  defined  for  both  methods  of 
classification  of  the  failure  modes.  In  Section  4.3,  the  projection  models  are  defined.  This 
includes: 

1.  the  AMPM-Stein  model  based  on  two  classifications; 

2.  the  AMPM-Stein  model  based  on  one  classification; 

3.  the  AMSAA-Crow  model  based  on  two  classifications;  and 

4.  the  AMSAA-Crow  model  based  on  one  classification. 

The  projections  are  then  calculated  in  Section  4.4.  This  includes  the  projections  of  the 
AMSAA-Crow  model,  and  the  AMPM-Stein  model  using  both  MME  and  MLE,  for  one  and 
two  classifications  of  failure  modes.  In  Section  4.5,  repeat  A-modes  are  reclassified  to 
B-modes.  This  process  not  only  entails  identifying  and  reclassifying  the  repeat  A-modes,  but 
involves  redefining  the  data  structures  for  both  mode  classifications.  Following  the  reclassifi¬ 
cation  process,  the  projections  are  recomputed  in  Section  4.6.  This  is  done  to  examine  the 
impact  reclassification  of  A-modes  has  on  the  various  projections.  Finally,  the  necessary  data 
is  saved,  and  the  results  are  displayed  in  4.7. 

4.2  Data  Generation. 

4.2.1  Simulation  Inputs. 

All  of  the  inputs  necessary  to  perform  one  execution  of  the  simulation  are  defined  below. 
EAa,k,  and  EAB#K  are  the  expected  A-mode,  and  B-mode  failure  rates,  respectively.  kA,  and 
kB  are  the  number  of  generated  A-mode,  and  B-mode  failures,  respectively.  T  is  the  length 
of  the  test  phase.  aa ,  and  /3a  represent  the  shape,  and  scale  parameters,  respectively,  for  the 
gamma  distribution.  The  values  in  the  first  argument  of  aa,  and  /3a  are  the  parameters  used 
to  generate  A-mode  failure  rates.  Similarly,  the  B-mode  failures  rates  are  generated  using  the 
values  in  the  second  argument.  The  variable  dist  determines  the  distribution  for  which  the 
failure  rates  are  drawn;  1  for  gamma,  2  for  lognormal,  and  3  for  Weibull.  The  following 
Mathematica  code  defines  the  inputs  and  prints  the  relevant  values  in  Table  1  below. 


<<  Statistics" 

dist  =  1;  (*1-Gamma,  2-Lognormal,  3-Weibull  *) 
EAB/k  =  10'1  /  1.5; 
kA  =  6; 


kB  =  10; 

/3a  =  {10'4,  lO'4}; 


eaA/K 


EAB/K  kA  fia  [[111 
kB  /Ball]] 


eaA/K 
kA  /3alEl]3 


EAb  f  K 

kB/3aI2]l  J  ' 


T  =  1000; 


Hn  =  Log [ 
fiw  = 


Ota  fie 


Jl  +  — 

V  aa 


Gamma [ 1 +  — ]  -  Gamma [ 1 +  — ] 2 

•[x  /  .  FindRoot  [ - ^ ^ 

Gamma  [  1  +  —  ] 

2  *i  2 

Gamma [ 1 +  — ]  -  Gamma [ 1 +  ^ ] 
Gamma  [  1  +  —  ] 


0W  — 


x  /  .  FindRoot [ 

ota  li  a 


Ota  III 
1 

Ota  12 1 


•  {x/  i}  ]  / 


{x,  i}]}; 


Gamma  [  1  +  —  ] 

TableForm[ 

{{kA,  kB ,  T,  Which[dist  ==  1,  "Gamma",  dist  ==2,  "Log  Normal", 


dist==3,  "Weibull" ]  ]•  ]■ ,  TableHeadings -> 

{None,  {"A-Modes",  "B-Modes" ,  "Test  Length",  "Distribution"}}, 
TableAlignments  -»  Center] 

A-Modes  B-Modes  Test  Length  Distribution 

6  10  1000  Gamma 

Table  1.  Simulation  Inputs. 
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Table  1  shows  that  the  length  of  the  simulated  test  is  1,000  hours.  The  table  also  indicates 
that  6  A-mode,  and  10  B-mode  failure  rates  were  generated.  Only  a  small  number  of  failure 
modes  are  generated  in  this  demonstration.  This  is  done  for  illustrative  purposes,  and  mini¬ 
mizes  the  volume  of  data  printed  in  following  sections.  The  data  (i.e.  MTBF  projections, 
mean  squared  error,  and  variance,  etc.)  that  is  examined  to  support  the  conclusions  in  this 
study  are  obtained  by  generating  100  A-modes,  and  500  B-modes,  1,000  times.  These  results 
are  shown  in  Section  5.  Finally,  Table  1  also  indicates  that  the  failure  rates  are  randomly 
drawn  from  a  gamma  distribution.  The  parameters  and  PDF  for  this  distribution  are  displayed 
in  the  following  section. 

4.2.2  Distribution  Parameters  and  PDFs. 

Associated  with  the  methodology  for  which  AMPM-Stein  is  based,  is  the  assumption  that  the 
failure  rates  are  a  realization  from  a  random  sample  of  numbers  drawn  from  a  gamma  distribu¬ 
tion.  To  examine  the  sensitivity  of  this  assumption,  the  option  for  generating  the  failure  rates 
from  a  lognormal  or  Weibull  distribution  is  incorporated.  Although  the  present  run  is  generat¬ 
ing  failure  rates  from  a  gamma  distribution,  the  corresponding  PDF  plots  and  parameters  are 
provided  for  the  lognormal,  and  Weibull  distributions.  When  making  comparisons  of  the 
projection  results  obtained  from  the  use  of  three  different  distributions,  one  must  use  parame¬ 
ters  which  result  in  identical  means  and  variances  for  each  distribution.  Otherwise,  the  results 
would  not  be  comparable.  To  demonstrate  that  the  results  are  comparable,  distribution  parame¬ 
ters  and  PDFs  are  displayed  below.  The  following  Mathematica  code  generates  the  plots 
shown  in  Figures  1  through  3. 

xl  =  Mean  [GammaDistribution  [aa[[l]l ,  /3a|Il]]]]; 

Plot  [PDF  [GammaDistribution  [aa |[1]| ,  /3a[[l]]],  x]  , 

{x,  0,  .01},  PlotRange  -*  {0,  600),  Frame  ->  True, 

FrameLabel  -*  { "Failure  Rate",  "ffx)"}. 

Epilog  -»  {Text  [  "x" ,  (xl,  550}],  Line[{{xl,  0},  {xl,  525}}], 

Text [TableForm [Map [NumberForm [# ,  {5,  4}, 

NumberPadding  ,  "0"}]  &,  {  {N[aa[[l]]  ]  ,  N[aa[[2]]]}, 

{N[£a|Il]]]#  N[/3a[[2]]  ]  }  }  ,  {2}],  TableHeadings -» 

{{"a",  "13"  },  {  "A-Modes" ,  "B-Modes"  }  }  ,  Table  Alignments  -» 
Right,  TableSpacing  -*  {0 ,  1}],  {.003,  500}]}]; 
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x2  =  Mean  [LogNormalDistribution[^n[[l]] ,  an[[l]]]]; 

Plot  [PDF  [LogNormalDistribution[/in[[l]] ,  anHl]]],  x]  , 

{x,  0,  .01}/  PlotRange -»  {0,  600},  Frame  -*  True, 

FrameLabel -»{  "Failure  Rate",  "g(x)"}. 

Epilog {Text  [  "x" ,  {x2,  550}],  Line[{{x2,  0},  {xl,  525}}], 
Text  [TableForm[Map  [NumberForm[#,  {5,  3}, 

NumberPadding  -*  {  "  "  ,  "0"}]  &,  {  {N  [Mn  M  ]  >  N[an[[l]]]}, 
{N[^n[[2]]],  N[an[I2]]  ]  }  }  ,  {2}],  TableHeadings -> 

{{"/i"  ,  "a"},  {"A-Modes"  ,  "B-Modes"  }  }  ,  TableAlignments  -» 
Right,  TableSpacing  ->  {0,  1}],  {.003,  500}]}]; 

x3  =  Mean  [WeibullDistribution  [/3W[[1]] ,  ©w[[l]l]]; 

Plot  [PDF  [WeibullDistribution  [/3W[[1]] ,  ©will]  /  x]  , 

{x,  0,  .01},  P  lot  Range  -*  {0,  600},  Frame  ->  True, 

FrameLabel -»{ "Failure  Rate",  "h(x)"}. 

Epilog -»  {Text ["x" ,  {x3 ,  550}],  Line[{{x3,  0},  {x3,  525}}], 
Text [TableForm[Map [NumberForm[#,  {5,  3}, 

NumberPadding  -*  {"",  "0"}]  &,  {  {N  [/3W[[1I  ]  ,  N[©w[[l]]]}, 
{N[£w|[2]]],  N[©wpj]}},  {2}],  TableHeadings  -» 

{{"/3" ,  "©"},  {"A-Modes",  "B-Modes"}},  TableAlignments-* 
Right,  TableSpacing  -*  {0,  1}],  {.003,  500}]}]; 


Figure  1.  Gamma  PDF  and  Parameters. 
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Figure  1  shows  a  plot  of  the  gamma  Probability  Density  Function  (PDF)  whose  parameters 
are  printed  in  the  top  left  comer.  The  A  and  B -modes  failure  rates  were  generated  via  these 
parameters.  This  includes  the  gamma  shape  and  scale  (a  and  J3)  parameter  values  of  66.6670 
and  0.0001,  respectively.  The  mean  and  variance  for  this  distribution  are  approximately 
0.0067  and  6.7  x  1 0-7 ,  respectively. 
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Failure  Rate 


Figure  2.  Lognormal  PDF  and  Parameters. 

Similarly,  Figure  2  shows  the  parameters  and  plot  of  the  lognormal  PDF.  The  values  that  are 
displayed  are  the  mean  and  variance  parameters  to  the  corresponding  normal  distribution. 
These  values  result  in  a  mean  and  variance  identical  to  that  discussed  above  for  the  gamma 
distribution.  For  example,  since  these  values  are  based  on  a  normal  distribution, 
^,-5.018  _  0.0067,  which  is  the  mean  shown  above. 
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Figure  3.  Weibull  PDF  and  Parameters. 

The  parameters  for  the  Weibull  distribution  are  found  in  the  same  fashion.  Figure  3  shows 
the  parameter  values  and  plot  of  the  PDF.  Likewise,  the  mean  and  variance  are  identical  to 
the  previous.  It  is  also  noted  that  the  shape  and  scale  of  the  PDFs,  while  not  identical,  are  as 
closely  related  as  possible.  Having  identical  means  and  variances,  shows  that  projection 
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results  obtained  from  generating  failure  rates  from  either  of  the  above  distributions  are  compa¬ 
rable.  In  the  next  section,  the  failure  rates  for  this  demonstration  are  generated  from  the 
gamma  distribution  shown  in  Figure  1. 

4.2.3  Failure  Rates. 

The  Mathematica  code  below  randomly  draws  A-mode  and  B-mode  failure  rates  based  on 
one  of  the  three  distributions  previously  discussed.  The  list  of  kj  A-mode  failure  rates  is 
denoted  by  A  a  ■  Similarly,  A^  is  a  list  of  kg  B-mode  failure  rates.  These  rates  for  both  the  A, 
and  B-mode  failures  are  printed  in  Table  2  below.  The  blank  space  in  Table  2  results  from 
generating  fewer  A-mode  failure  rates  in  comparison  to  the  number  of  B-modes. 

Aa  =  Which [ 
dist  ==  1, 

Table  [Random [GammaDistribution  [aa[[l]] ,  /3a[[l]]]]/  (i/  kA}], 
dist  ==2,  Table  [Random  [LogNormalDistribution  [hnfflj  /  CTnll]]]]# 

(i/  kA}] , 

dist  ==  3,  Table  [Random[WeibullDistribution[/3w[[l]] ,  ©will]]  / 

{if  kA}]]; 

Ab  =  Which [ 
dist  ==  1, 

Table  [Random  [GammaDistribution  [aa[[2]] ,  /3a[[2]]]],  (i,  kB}], 
dist  ==2,  Table  [Random[LogNormalDistribution[^/n[[2]] ,  an[[  2J]], 

{if  kB} ] , 

dist  ==3,  Table  [Random  [WeibullDistribution  [/3W[[2]] ,  ©„I[2]]]], 

{if  kB} ] ] ; 
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If[kA>kB,  Table  [AppendTo [AB,  {i,  kA-kB}], 

Table  [AppendTo [Aa,  {i,  kB-kA}]]; 

TableForm[Map [NumberFormf#,  {7,  6},  NumberPadding -»  ,  "0" }, 

ExponentFunction (Null  &)  ]  &,  Transpose [ {Aa,  Ab}],  {2}], 
TableHeadings -»  {Automatic,  {"A-Mode",  "B-Mode" }  } ] 


A-Mode 

B-Mode 

1 

0 . 008288 

0 . 007838 

2 

0 .006374 

0.006398 

3 

0 . 007915 

0 . 006058 

4 

0 . 006143 

0 . 006842 

5 

0 . 006921 

0 . 005768 

6 

0 .007982 

0.006620 

7 

0 . 007217 

8 

0 . 006210 

9 

0 .007258 

10 

0 . 006082 

Table  2.  A  and  B  Mode  Failure  Rates. 

There  are  6  A-modes  and  10  B-modes  shown  in  Table  2.  These  numbers  were  generated 
from  a  gamma  distributions  with  mean  of  approximately,  0.0067.  The  shape  of  this  distribu¬ 
tion  is  displayed  in  Figure  1  of  the  preceding  section 

4.2.4  Generating  Uniform  Random  Numbers. 

Ica  and  kg  uniform  random  numbers  are  drawn  below.  These  random  numbers  will  be  uti¬ 
lized  in  the  next  section  to  calculate  the  first  occurrence  time  (FOT)  for  each  mode.  The 
following  Mathematica  instructions  draw  the  numbers  randomly  from  a  uniform  distribution 
over  the  interval  [0,1]  and  print  the  data  in  Table  3.  The  black  space  in  the  table  is  due  to 
generating  a  fewer  number  of  A-modes  than  B-modes. 
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UA  =  Table  [Randoxn[]  ,  {i,  kA}]; 

UB  =  Table  [Random []  ,  {i,  kB}]; 

If  [kA  >  kB/  Table  [AppendTo  [UB/  {i,  kA-kB}], 

Table  [AppendTo  [UA ,  ,  (i,  kB-kA}]]; 

TableForm[Map [NumberForm[#,  {5,  4},  NumberPadding -»  "0"}, 

ExponentFunction (Null  &)  ]  &,  Transpose  [  {UA,  UB}],  {2}], 
TableHeadings -»  (Automatic,  ("A-Mode",  "B-Mode"}}] 


A-Mode 

B-Mode 

1 

0.2531 

0 . 1236 

2 

0 . 1803 

0.2584 

3 

0 . 9385 

0 . 1313 

4 

0 . 7706 

0.4658 

5 

0 . 1023 

0 . 7674 

6 

0.7458 

0 . 6014 

7 

0.7375 

8 

0.5076 

9 

0 . 0125 

10 

0.5792 

Table  3.  Uniform  Random  Numbers. 

4.2.5  First  Occurrence  Times. 

The  uniform  numbers,  and  the  A-mode  and  B-mode  failure  rates  from  the  preceding  sections 
are  utilized  to  compute  the  FOTs.  In  this  execution  of  the  simulation  the  length  of  the  test 
phase  is  T  =  1,000  hours.  Any  FOT  greater  than  1,000  referred  to  as  an  unsurfaced  mode. 
The  following  Mathematica  code  calculates  the  FOTs  and  prints  the  data  Table  4  below. 
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If  [kA  >  kB,  AB  =  ReplaceAll [AB,  ""  -»  1]  ;  UB  =  ReplaceAll  [UB f  n"  -»  1]  , 

Aa  =  ReplaceAll  [Aa,  ■■  -»  1]  ;  UA  =  ReplaceAll  [UA,  ""  -*•  1]  ]  ; 

-Log  [UA]  “Log  [UB] 

tA  =  - - - ;  tB  =  - - - ; 

aa  ab 

If[kA>kB,  tB  =  ReplaceAll [tB,  0 n  "]  # 
tA  =  ReplaceAll  [tA,  0 " 11  ]]; 

TableForm[Map [NumberForm[#,  {50/  0},  NumberPoint  -»  "  "  , 
DigitBlock  -»  3 ,  NumberPadding -*  ,  " 0" }, 

ExponentFunction (Nulls)]  &,  Transpose  [  {tA/  tB}],  {2}], 
Table  Alignments  -»  Right, 

TableHeadings  {Automatic,  {"A-Mode",  "B-Mode"}}] 


A-Mode 

B-Mode 

1 

166 

267 

2 

269 

212 

3 

8 

335 

4 

42 

112 

5 

329 

46 

6 

37 

77 

7 

42 

8 

109 

9 

604 

10 

90 

Table  4.  First  Occurrence  Times. 

Table  4  displays  the  A,  and  B-mode  first  occurrence  times.  Note  that  all  modes  were  surfaced 
byT. 

4.2.6  Fix  Effectiveness  Factors. 

Fix  Effectiveness  Factors  (FEFs)  represent  the  fraction  reduction  of  initial  mode  failure  rate 
due  to  corrective  action.  The  beta  distribution  is  utilized  in  randomly  generating  the  FEFs. 
Using  the  beta  distribution  we  generate  ks  FEFs,  denoted  by  dg,  for  the  B-mode  failures. 
Since  the  A-mode  failures  remain  unfixed,  the  FEFs  for  the  A  modes,  dA ,  are  set  equal  to  0. 
The  following  Mathematica  code  generates  the  FEFs  and  prints  the  data  in  Table  5  below. 
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c  =  0  •  8 ; 
v  =  0.1; 

1  -  c  -  c  v2 


dA  =  Table  [0,  {i,  kA}]; 

dB  = Table [Random[BetaDistribution [q,  r]  ]  ,  {i,  kB}]; 

If  [kA  >  kB ,  Table  [AppendTo  [dB ,  n,,3#  {i,  kA-kB}], 

Table  [AppendTo  [dA ,  "  "  ]  ,  {  i ,  kB  -  kA }  ]  ]  ; 

TableForm[Map  [NumberForm[#,  {5,  4},  NumberPadding-*  {  ,  "0"), 

ExponentFunction  -*  (Null  &)  ]  &,  Transpose [ {dA ,  dB }  ]  ,  {2}], 
TableHeadings -»  {Automatic,  {"A-Mode",  "B-Mode"}}] 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


A-Mode 
0 . 0000 
0 . 0000 
0 . 0000 
0.0000 
0 . 0000 
0 . 0000 


B-Mode 
0 . 8571 
0 .8177 
0 . 5545 
0.8034 
0 .8060 
0 . 8287 
0.8432 
0 .5157 
0 . 7203 
0 . 9312 


Table  5.  Fix  Effectiveness  Factors. 


4.2.7  Failure  Times. 

Using  FOTs  calculated  in  section  4.2.5,  a  sequence  of  failure  times  up  to  time  T  for  each 
failure  mode  are  generated.  The  following  Mathematica  code  defines  the  function  'timeline.' 
This  function  uses  the  FOTs  and  failure  rates  to  calculate  the  failure  times.  The  function  is 
called  twice,  once  for  the  A  modes,  and  once  for  the  B  modes.  The  failure  times  are  then 
printed  in  Table  6  below.  "Null"  may  appear  in  place  of  a  sequence  of  failure  times  for  some 
modes.  This  occurs  for  the  unsurfaced  modes,  or  modes  whose  FOT  is  greater  than  T. 
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If[kA>kB,  tB  =  DeleteCases  [tB#  ""3//  tA =  DeleteCases [tA, 
timeline [tlist_,  Alist_]  :=  { 
tl  =  Table [ 

If [tlistffi]]  ^  T,  {tlist HiJ } ,  Null],  {i,  Length [tlist] }] ; 
For  [i  =  1,  i  <  Length[tl]  ,  While  [Max[tl[[i!  ]  ^  T, 

Log [ Random [] ] 


NewT  =  Max[tlffi]]]  - 


Alist[[i]] 


If  [NewT  ^  T,  AppendTo  [tl[[i]] ,  NewT]  ,  Break  []  ]  ;  ]  ;  i  +  +  ]  ;  tl]  ; 
TA  =  Flatten  [timeline  [tA/  Aa]  ,  1]  ; 

TB  =  Flatten  [timeline  [tB/  AB]  ,  1]  ; 

If  [kA  >  kB,  Table  [AppendTo  [TB,  ""],  {i,  kA-kB}], 

Table  [AppendTo  [TA,  ""],  {i,  kB  -  kA  >  ]  ]  ; 

TableForm[Map  [NumberForm[#,  {6,  0},  DigitBlock -4  3 , 

NumberPoint  ->  " " ]  &,  Transpose [ {TA,  TB}],  {3}], 
TableHeadings -» {Automatic,  {"A-Mode",  "B-Mode"}}, 
TableAlignments  -4  Right] 


A-Mode 

B-Mode 

166 

267 

218 

356 

289 

361 

362 

378 

415 

496 

437 

500 

501 

596 

762 

765 

941 

846 

269 

391 

212 

411 

299 

533 

8 

42 

162 

429 

456 

335 

490 

754 

556 

933 

688 

801 

815 

925 

42 

87 

264 

112 

286 

142 

430 

281 

443 

312 

490 

418 

535 

94  8 

808 

867 

35 


5 


6 


7 


8 


9 


10 


329 

348 

394 
451 
544 
646 
718 
739 
779 
794 
991 

37 

54 

146 

349 

395 
474 
536 
567 
600 
630 
651 
715 


46 

718 

795 

942 


77 

174 

234 

323 

607 

696 

937 


42 

108 

256 

320 

497 

582 

109 

209 

331 

632 

892 

604 

716 

803 

90 
235 
946 
94  8 


Table  6.  Failure  Times. 

Since  all  of  the  failure  modes  in  this  run  were  surfaced  by  T,  there  is  a  sequence  of  failure 
times  for  each  mode.  Table  6  displays  the  failure  times  in  ascending  order.  By  inspection, 
one  notices  that  all  the  failure  times  occur  in  the  interval  [0,T].  Also,  the  number  of  failure 
times  varies  per  mode.  This  reflects  the  randomness  of  the  routine  used  to  generate  the  failure 
times. 
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4.2.8  Data  Structures  -  Two  Classifications. 

In  the  "Two  Classification"  case,  A-mode  failures  and  B-mode  failures  are  classified  sepa¬ 
rately,  and  are  not  utilized  in  a  unified  fashion  when  making  reliability  projections.  In  this 
case,  a  number  of  data  structures  are  defined,  tb  is  a  list  of  B-mode  FOTs.  m  is  the  number 
of  surfaced  B-modes.  Naj,  and  Ngj  are  the  number  of  A-mode,  and  B-mode  failures  for 
mode  i,  respectively.  Na  ,  and  NB  are  the  total  number  of  A-mode,  and  B-mode  failures, 
respectively.  SBM  is  an  index  set  of  all  surfaced  B-mode  FOTs.  d*  is  a  list  of  all  FEFs  for 
the  surfaced  B-modes.  fid*  is  the  average  FEF  for  the  surfaced  B-modes.  The  following 
Mathematica  code  defines  these  variables.  Due  to  the  volume  of  information  associated  with 
these  data  structures,  they  are  not  printed. 

If [kA  >  kB# 

dB  =  DeleteCases [dB/  ""3; 

AB  =  DeleteCases [AB/  1]  ;  TB  =  DeleteCases [TB,  "  "  ];, 
dA  =  DeleteCases  [dA/  "  "  ]  ;  Aa  =  DeleteCases [Aa,  1]  ; 

TA  =  DeleteCases [TA,  "  "  ]  ]  ; 
tb  =  Select [tB,  #  <  T  &] ; 
m  =  Length  [tb  ]  ; 

NA/i  =  Map  [Length  [#]  &,  TAJ  ; 

NB,i  =  Map  [Length  [# ]  &,  TB]  ; 

Na  =  Total  [NAii]  ; 

Nb  =  Total  [NB,i  J  ; 

SBM  =  Position [tB/  _?  (#  3  T  &)  ]  ; 
d*  =  Extract  [dB/  SBM]  ; 


4.2.9  Data  Structures  -  One  Classification. 

"One  Classification"  of  failure  modes  refers  to  a  unified  treatment,  where  failure  modes  are 
not  classified  depending  on  implementation  of  corrective  action.  In  this  case,  A-mode  and 
B-mode  failures  are  contained  in  one  list.  A-modes  are  only  distinguished  from  B-modes  via 
a  zero  FEF.  Aab  is  a  list  which  contains  all  of  the  A-mode  and  B-mode  failure  rates.  TAB  is 
a  list  containing  all  A-mode  and  B-mode  failure  times.  Aab,/  is  the  number  of  failures  for 
A-mode  or  B-mode  i.  Aab  is  the  total  number  of  A-mode  and  B-modes  failures.  SABM  is 
an  index  set  of  all  surfaced  A-mode  and  B-mode  FOTs.  dA b  is  a  list  which  contains  all 
A-mode  and  B-mode  FEFs.  The  A-mode  FEFs  are  zero  since  the  modes  are  unfixed.  dAB  is 
a  list  of  all  FEFs  for  the  surfaced  A-mode  and  B-mode  failures.  kA b  is  the  total  number  of 
A-mode  and  B-mode  failures  that  were  generated  in  the  simulation,  m2  is  the  total  number  of 
surfaced  A,  and  B-mode  failures  by  time  T.  The  following  Mathematica  code  defines  these 
data  structures.  The  associated  data  is  not  printed  due  to  the  volume  of  output. 
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Aab  =  Join  [Aa  ,  Ab]  ; 

TAB  =  Join [TA,  TB]  ; 

Nab,!  =  Map  [ Length [ # ]  &,  TAB]  ; 

Nab  =  Total  [NAB,i]  ; 
tAB  =  Join [ tA/  tB]  ; 

SABM  =  Position  [tAB#  _?  (#  ^  T  &)  ]  ; 

dAB  =  Join  [dA/  dB]  ; 

dAB  =  Extract  [dAB/  SABM]  ; 

J^ab  =  kA  +  kB ; 

m2  =  Length  [Select  [tAB/  #  £  T  &]  ]  ; 


4.3  Projection  Models. 

4.3.1  AMPM-Stein  using  Two  Classifications. 

The  following  Mathematica  code  defines  the  AMPM  based  on  Stein  estimation  in  the  two 
classification  case,  where  failure  modes  are  classified  according  to  whether  they  will  be 
addressed  by  corrective  action,  or  remain  unfixed.  The  function  'Stein2C'  is  defined  for 
repeated  use.  The  function  requires  two  inputs,  namely  the  estimates  for  the  shape  parameter, 
/?,  of  the  gamma  distribution,  for  which  the  failure  rates  are  drawn.  This  estimate  of  / 3  is 
obtained  in  the  case  where  the  number  of  modes  is  a  known,  or  assumed  (i.e.  finite  k),  and  in 
the  case  where  there  is  a  large,  and  unknown,  number  of  modes  (i.e.  k-*oo).  Although  there 
are  a  numerous  equations  listed  below,  there  are  essentially  four  model  equations,  but  they  are 
calculated  in  a  number  of  different  types  of  cases.  The  four  model  equations  include  the  Stein 
shrinkage  factor,  a,  the  mode  failure  rate,  A,  the  rate  of  occurrence  of  new  B-modes,  h,  and 
the  failure  rate,  p.  The  different  cases  these  values  are  calculated  in  are  as  follows: 

1 .  actual  value  in  the  finite  case, 

2.  actual  value  in  the  infinite  case, 

3.  estimate  in  the  finite  case,  and 

4.  estimate  in  the  infinite  case. 


Since  all  required  data  is  simulated,  actual  values  are  calculated  and  compared  to  the  corre¬ 
sponding  estimates.  The  subscripts  on  the  variables  indicate  which  case  the  variable  is  com¬ 
puted  for,  subscripts  including  "a",  and  "h"  indicate  "actual  value,"  and  "estimated  value," 
respectively.  Subscripts  including  "K,"  and  "oo"  indicate  that  the  variable  is  based  on  the 
assumption  of  a  finite  number  of  modes,  and  infinite  modes,  respectively. 


Stein2C  [/3oo_,  /3k_]  :=  { 
T  (i  k 


Ots,K,h  = 


1  +  T  /3k 


Ah  = 


NB,i 
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.  (  nb  \ 

AS(K,h  =  as,K,h  Ah  +  (1  -  as,K/h) 

Variance [AB]  (kB -  1) 


ocs,k  = 


OIS,oo  = 


.  .  .  ,  ,,  Total[AB]  /..  1  \ 

Variance  [AB]  (kB  -  1)  +  - - -  (1  -  ) 


As,K  =  ttS/K 


gaPI  T 
1  +  M2JT 
NB/i 


+  (1  -  Os 


0co  = 


/3oo  T 


1  +  j3ooT 

NB,  i 

As ,  co ,  h  =  0co 

NBli 


As  ,oo  =  Os,< 


kE-m 


hS(K  =  Delete  [As,k*  SBM][[j]]; 
j=i 

kB-m 

hs,K,h  =  ^  Delete  [As,K,h#  SBM][[j]]; 
j=i 

/  N  a  \ 

hs,oo  -  (2-  _  aS,oo)  [  j  ' 

hs,oo,h  =  (1  -  0co)  (  — ] ; 
kB-m 

ha  =  ^  Delete  [AB/  SBM][[j]]; 
j=i 

Na  T— l 

pSiK  =  — -  +  2  ( 1  -  d* Ijl )  Extract  [As, K,  SBM]  C j U  +  hs,K; 


j=i 


P S,K,h 


Ps,co  - 


P  S,°=<h 


Na 

T 


Na 

T 


+ 


Na 

T 


m 

+  ^  (1  -  d*HjJ)  Extract  [As,K,h,  SBM]  [[jj  +  hs,K,h; 
j=i 

m 

(1  -  d* fljJ )  Extract  [As, oo,  SBM]  C j ]]  +  hs,co; 
j=i 

m 

+  ^  (1  -  d*[[jl)  Extract  [As, oo,h,  SBM]  Hjl  +  hs^^ 
j=i 
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kB 

Pa  =  Total  [Aa]  +  ^  (1  -  dB  E j ]] )  Ab I j ]]  + 
j=i 

Total [Delete [dB,  SBM]  Delete [AB,  SBM] ] ; 
stein2c  =  {1 /pa,  l/pS/K/  1/Ps,ic,h#  1  /  (Ps,co,h)  }  ;  }  ; 


4.3.2  AMPM-Stein  using  One  Classification. 

The  Mathematica  code  below  defines  the  AMPM  based  on  Stein  estimation  in  the  case  where 
all  modes  are  treated  in  a  unified  fashion.  The  model  equations  are  identical  to  those  already 
seen  from  the  previous  section.  The  use  of  the  associated  data  structures  for  the  one  classifica¬ 
tion  case  is  the  only  difference.  The  function  'Stein  1C  is  defined  for  repeated  use.  The 
description  of  variables  in  the  preceding  section  applies  for  the  variables  below. 


SteinlC  [/3oo_,  /3k: _ ]  :=  ■[ 

Off [General : : spelll] ; 

c*s,k  =  (Variance  [Aab]  (k^-l))  j 

Total  [Aae] 


Variance  [Aab]  (kM  -  1)  + 


«S,03  = 


/3aE2]]  T 

1  +  /3aE2]]  T 


NAB(i  /I  X 

As,K  =  0(s,K  -  +  (1  -  &S,k) 

T 

/Boo  T 

©OO  —  —————  J 

1  +  /3oo  T 

^  ^  Nab,! 

-^*S,oo,h  —  @co  7 

T 


(— ]; 
v  kAB  T  / 


As,  00  =  ot  s,c 


Nab,  i 


Kap  -m2 


hs,K  =  ^  Delete  [As,Kf  SABM][[j]]; 

j=i 


ffs,K,h  = 


T  /3k 


1  +  T  /3k 
Nab,i 


As,K,1i  =  Os,K,h  Ah  +  (1  -  0£s,K,h)  f  - - )  i 

UabT/ 


kaB-m2 


hs,K,h  =  ^  Delete  [As,K/h,  SABMJJj]]; 
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k*B-m2 

ha  =  Delete  [Aab  ,  SABM][[j]]; 

j=i 

m2 

Ps,k  =  (1  ~  dABlIjl)  Extract  [AS(Kf  SABM]  Jj]]  +  hs,K? 

j=i 

m2 

Ps»K,h  =  2  “  dABffjJ)  Extract  [As, K#h/  SABM]  [[jj  +  hs,K/h; 

j=i 

m2 

Ps.co  =  ^  (1  -  dABftj]])  Extract  [As,.*,,  SABM]  [[ j B  +  hSi00; 
j=i 

m2 

Ps,inf,h  =  ^  (l-dAB[[j]])  Extract  [AS/CO,h,  SABM]  [[ j I  +  hs#co,h; 
j=i 

kRB 

pa  =  ^(l-dAB|IjIl)  AABIjI|  + 
j=i 

Total  [Delete  [das,  SABM]  Delete[AAB,  SABM]]; 
steinlc  =  {1  /pa,  l/ps,K/  l/Ps,K,h*  1  /  (Ps,inf,h)  }  ;  } ! 


4.3.3  AMSAA-Crow  using  Two  Classifications. 

For  comparison  purposes,  reliability  projections  using  the  AMSAA-Crow  model  are  exam¬ 
ined.  The  following  Mathematica  code  defines  the  function  'AMSAACrow2C',  which  calcu¬ 
lates  the  model  equations  of  the  AMSAA-Crow  model  in  the  two  classification  case.  fic,  and 
fic,u  are  the  biased,  and  unbiased  MLE,  respectively,  of  the  shape  parameter  of  the  model. 
Similarly,  Ac,  and  Ac,„  are  the  biased,  and  unbiased  MLE,  respectively,  of  the  scale  parameter 
of  the  model.  hc  is  the  biased  estimate  of  the  rate  of  occurrence  of  new  B-modes  at  the  end  of 
the  test  phase.  hc  u  is  the  unbiased  estimate.  The  biased  and  unbiased  estimate  of  the  system 
level  failure  intensity  are  denoted  by  pc  and  pc,„,  respectively.  The  corresponding  MTBFs 
are  Mc  and  MCyU . 
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AMSAACrow2C[]  :=  { 

Zt.1  d*  PI 


Ha  = 
fic  = 


m 


m 


£.»  *>*[«!»] 


in  -  1 

fic,n  =  fid 

m 

m 

Ac  =  “  / 


T^c 


m 


C'U  “  ' 

“ppc.u 


hc  =  Ac  fic  T^-1; 

h_  }  A  T>^c'u-1  . 
c,u  —  -/'-c,u  Pc,u  ■*■  / 


N# 


Pc  = 


JU 

+  2  (1-d‘IjJ) 


j  =  l 


NB,iIj]l 

T 

NB(ilEj31 


+  Md*  hc ; 


Na  A  f  NB(iIEj3}  \ 

Pc,u  =  -  +  ^  (1  -  d*Ij]])  -  +Pd*hc,u; 

T  j=i  '  T  ' 


Mc  =  - ; 

Pc 

1 

MC,U  =  - 

Pc,l 


un.hd.3S6d  —  f^c,u»  AC(U#  hC(U#  Pc,u/  MC(U}  /  } » 


4.3.4  AMSAA-Crow  using  One  Classification. 

The  following  Mathematica  code  defines  the  function  'AMSAACrowlC',  which  contains  the 
model  equations  utilized  in  the  one  classification  case.  The  model  equations  are  identical  to 
that  used  in  the  two  classification  case.  However,  the  data  structures  below  compensate  for 
treating  A  and  B-modes  in  a  unified  fashion.  The  discussion  of  the  variables  in  the  preceding 
section  explain  the  estimates  below. 
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4.4  Reliability  Projections. 

4.4.1  MME  using  Two  Classifications. 

The  method  of  moments  (MME)  estimates  are  obtained  below  for  two  cases.  In  the  first  case 
a  finite  number  of  modes  is  assumed.  The  second  case  calculates  the  MME  where  the  num¬ 
ber  of  modes  approaches  infinity.  This  case  is  useful  in  situations  where  there  are  a  large,  but 
unknown,  number  of  failure  modes.  The  MMEs  are  used  in  the  function  call  for  the  AMPM- 
Stein  based  on  two  classifications.  Projections  from  the  AMSAA-Crow  model  are  also 
obtained.  Finally,  the  associated  sum  of  squared  error  for  the  models  is  calculated.  These 
results  are  stored  and  compared  against  the  other  projections  at  the  end  of  the  simulation  run. 
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*B 

-E 


j=i 

kB  /  NB,i  |Ij]|  \  2 


Mu 


^  »8,lUl  j 


k: 

j=i 


aM  = 


kB  Au‘ 


kB  (Mu  -  Au2)  -  -2-  Au 
Au 


;  (*  EQUATION  7.159,  MARTZ  &  WALLER.  *) 


/3M  =  - ;  (*  EQUATION  7.160,  MARTZ  &  WALLER.  *) 

C*M 

1  2j.i  Extract  [NB(i2,  SBM]  [[ j ]] 

^Mo 3  =  —  1  / 

.  T  Zj=!  Extract  [NB(i,  SBM]  [[jj 

Stein2C[/3Mo>,  Mi 
stein2cmme  =  stein2c; 

AMSAACrow2C [ ] ; 
crow2c  =  unbiased; 

kB 

AMPMSteinApproxk  =  ^  (AB[[j]]  -  AS(K,hIIj]) )  2 ; 

j=i 

AMPMSteinApproxco  =  (AB[[j]]  -  AS/00(h|Ij]J )  2  ; 

j=i 

AMPMSteinActual  =  (AB[[j]]  -  AS/K[[j]l)  2  ; 

j=i 

MMEerror  =  {AMSAACrowError , 

AMPMSteinApproxk,  AMPMSteinApproxco,  AMPMSteinActual} ; 


4.4.2  MME  using  One  Classification. 

The  MMEs  are  also  calculated  in  the  one  classification  case.  The  data  structures  used  below 
contain  all  mode  information,  unlike  those  of  the  preceding  section.  The  following  Mathemat- 
ica  code  calculates  the  MMEs,  executes  the  AMPM-Stein  and  AMSAA-Crow  models  and 
estimates  the  associated  sum  of  squared  error. 
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4.4.3  MLE  using  Two  Classifications. 

The  following  Mathematica  routine  calculates  the  MLEs  for  a  finite,  and  infinite  number  of 
modes  in  the  two  classification  case.  The  routine  obtains  the  AMPM-Stein  and  AMSAA- 
Crow  projections,  and  also  calculates  the  corresponding  sum  of  squared  error.  Again,  the 
results  are  shown  at  the  end  of  the  simulation  run. 
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check2  =  0; 

If  [Max  [NB/i]  >  1, 

I  nb  \ 

f  [x_]  :  =  -  Log  [1  +  x  T]  ; 

'xT' 

/3mleoo  =  x/.  FindRoot  [f  [x]  ==  m,  {x,  10"3}]; 
(*  EQUATION  7.172,  MARTZ  &  WALLER.  *) 
r  Nb2 

If  [kB  >  — - -  / 

Z?B=1  (Na.illjl  -1)  Nb ,  ±  E j  II 
check2  =  1; 


kfi  Nb,  i  [[  jj  -1 

1 

/  XTPkB 

\  Ne 

/BmleK  =  x /.  FindRoot  [g  [x]  ==  m,  {x,  10-3}];, 
"No  solution  to  /3k."]#  "No  repeats."]; 
Stein2C  [/3mleoo,  /3mleK]  ; 
stein2cmle  =  stein2c; 

AMSAACrow2C[] ; 

kB 

AMPMSteinApproxk  =  ^  (ABfljJ  -  As,K,h[[j]] )  2  ; 

j=i 


g  [x_]  :  =  f  [x] 


-zz 


kB 

AMPMSteinApproxoo  =  ^  (AB[[j]]  -  AS(00(hfl;j]] )  2  ; 

j=i 


AMPMSteinActual  =  (AB tt j B  -  AS(K[[j]] )  2  ; 

j=i 


AMSAACrowError  = 


MLEerror  =  {AMSAACrowError, 

AMPMSteinApproxk,  AMPMSteinApproxoo,  AMPMSteinActual} ; 


4.4.4  MLE  using  One  Classification. 

The  last  projection  method  that  is  examined,  before  reclassification  of  A-modes,  is  based  on 
MLE  in  the  one  classification  case.  The  following  Mathematica  code  calculates  the  MLEs, 
projections,  and  sum  of  squared  error. 
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check2  =  0; 

If  [Max  [NxB,i]  >  1, 

/  Nab  \ 

f  [x  ]  :=  -  Log[l  +  x  T]  ; 

'  x  T  ' 

/3mleoo  =  x  /  .  FindRoot  [f  [x]  ==  m2  ,  {x,  10~3}]; 
(*  EQUATION  7.172,  MARTZ  &  WALLER.  *) 


If  [kAB  > 


Nab“ 


25“  (NAB,ilIj]]  -  1)  NAB.illj]] 
check2  =  1; 

kxB 

g[  _ 

j=i  p=i 


k-AB  Nab, i  EjI 

[x-]!=fW‘Z  Z  177^ 


(  XTPkAB  \ 
\  Nab  / 


Nab 


/3mleK  =  x /.  FindRoot  [g  [x]  ==  m2  ,  {x,  10"3}];, 
"No  solution  to  /3K-" ],  "No  repeats."]; 
SteinlC  [/3mleoo,  /3mleK]  ; 
steinlcmle  =  steinlc; 

AMSAACrowlC [ ]  ; 

^AB 

AMPMSteinApproxk  =  ^  (AabI;]]]  -  As,K,h{[j]] )  2  ; 


j=i 

kAB 


AMPMSteinApproxoo  =  ^  (AabOjII  -  AS/oo,hlIjI )  2  ; 

j=i 

kAB 

AMPMSteinActual  =  ^  (AABlIjj]  -  As,k[IjI])2; 


j=i 

^AB 


\  *  (  NM#i  \ 

AMSAACrowError  =  y  ^ABljll - — — QjjJ  ; 


j=i 


MLEerrorlC  =  {AMSAACrowError, 

AMPMSteinApproxk,  AMPMSteinApproxoo,  AMPMSteinActual}; 
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4.5  Reclassification. 


4.5.1  Reclassifying  A-modes  -  Two  Classifications. 

The  following  Mathematica  instructions  reclassifies  some  A-mode  failures  as  B-modes,  and 
reorganizes  the  data  accordingly.  The  A-modes  that  are  reclassified  are  modes  that  program 
management  are  likely  to  fix,  namely  the  repeat  A-modes.  The  variable  repeats  is  the  index 
set  of  such  modes.  R  is  the  total  number  of  A-modes  that  are  reclassified.  All  other  variables 
below  were  previously  discussed.  The  following  process  of  reclassifying  the  A-modes  entails 
removing  all  data  associated  with  the  repeat  A-modes  from  the  corresponding  A-mode  data 
structures.  The  data  is  then  appended  the  appropriate  B-mode  data  structures.  Also,  the  FEFs 
for  the  reclassified  A-modes  are  updated  from  0  to  a  random  number  drawn  from  the  beta 
distribution  discussed  in  Section  4.2.6.  This  process  of  reclassifying  A-modes,  and  reorganiz¬ 
ing  the  data  is  performed  below  in  the  two  classification  case.  Due  to  the  volume  of  data 
involved,  the  following  variables  are  not  printed. 

repeats  =  Position  [NA(i ,  _  ?  (#  >  1  &)  ]  ; 

R  =  Length [repeats] ; 

AB  =  Join[AB,  Extract[AA,  repeats]]; 
kB  =  Length  [Ab]  ; 

Aa  =  Delete [Aa,  repeats] ; 
kA  =  Length [Aa]  ; 

tB  =  Join[tB,  Extract[tA/  repeats]]; 
tb  =  Join[tb,  Extract  [tA,  repeats]]; 
tA  =  Delete [tA,  repeats] ; 

TB= Join[TB,  Extract [TA,  repeats]]; 
m  =  Length  [tb]  ; 

NB,i  =  Map  [Length  [#]  &,  TB]  ; 

Nb  =  Total  [NB/i]  ; 

TA  = Delete [TA,  repeats] ; 

dB  =  Join[dB,  Table  [Random  [BetaDis  tribution  [q,  r]  ]  ,  {i,  R}]]; 
dA  =  Drop  [dA,  R]  ; 

SBM  =  Position[tB,  _?  (#  £  T  &)  ]  ; 
d*  =  Extract  [dB,  SBM]  ; 

*  Z”=1d‘Ii]J 

Pd  =  - > 

m 

NA,i  =  Map  [Length [#]  &,  TA]  ;  NA  =  Total  [NA<i]  ; 
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4.5.2  Reclassifying  A-modes  -  One  Classification. 

By  utilizing  the  variables  from  the  proceeding  section,  the  data  structures  for  the  one  classifica¬ 
tion  are  simply  redefined.  The  following  Mathematica  code  performs  the  required  update. 
The  projections  are  then  re-run  in  the  next  section. 

Aab  =  Join[AA#  Ag]  ; 

TAB  =  Join [TA,  TB]  ; 

Nab,i  =  Map  [Length [#]  &,  TAB]  ; 

Nab  =  Total  [Nab. i]  ; 
tAB  =  Join [tA/  tB]  ; 

SABM  =  Position  [tAB/  _?  (#  S  T  &)  ]  ; 

dAB  =  Join  [dA/  dB]  ; 

dAB  =  Extract  [dAB#  SABM]  ; 

kAB  =  kA  +  kB ; 

m2  =  Length[Select  [tAB#  #  £  T  &]  ]  ; 


4.6  Reliability  Projections  after  Reclassification. 

4.6.1  MME  using  Two  Classifications. 

The  following  Mathematica  instructions  recalculate  the  projections  based  on  MME  using  two 
classifications. 


Au 


kB 


1^  = 


(  MB.lgJJ  j 


k  A  2 

aM  =  - — - - ;  (*  EQUATION  7.159,  MARTZ  &  WALLER.  *) 

kB  (Mu  -  Au2)  -  Au 

Au 

/3M  = - ;  (*  EQUATION  7.160,  MARTZ  &  WALLER.  *) 

aM 

Extract  [NB)  i2  ,  SBM]  [[jj  } 

— - 1  ; 

Zj=i  Extract  [NB/i,  SBM]  ffj]J 

Stein2C  [^Mco,  /3M]  ; 
rstein2cmme  =  stein2c; 

AMSAACrow2C[] ; 
rcrow2c  =  unbiased; 

l^B 

AMPMSteinApproxk  =  (AB[[j]]  -  AS(K,h[[j]] )  2  ; 

j=i 

AMPMSteinApproxoo  =  ^  (AB[[jI]  -  As,ro,h[[j]] )  2  ; 

j=i 

AMPMSteinActual  =  ^  (ABHj]]  -  As,K[[j]] )  2  ; 

j=i 

rMMEerror  =  {AMSAACrowError , 

AMPMSteinApproxk,  AMPMSteinApproxoo,  AMPMSteinActual}; 


4.6.2  MME  using  One  Classification. 

The  Mathematica  routine  below  recalculates  the  projection  in  the  one  classification  case  using 
MME. 
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.  —HP,  J.  LL M 

Au  =  V  —7 — ;  Mu  =  V 

Z_J  kAB  Z_l 

j=l 


kAB  /  NiB.iljJ  \  2 


|  Nab, i  113]]  j 


j=l 


^AB 


kAB  Au 


0£m  = 


kAB  (Mu  -  V)  -  ^  Au 


(*  EQUATION  7.159,  MARTZ  &  WALLER.  *) 

Au 

/3m  =  - ;  (*  EQUATION  7.160,  MARTZ  &  WALLER.  *) 

aM 


/  ^-»jn2 


/^Mco  = 


Extract  [Nab,!2,  SABM]  Jj]j 


l  Zjfi  Extract  [Nab,!,  SABM]  j[ j  J 
SteinlC[/3M00/  /3M]  ; 

rsteinlcmme  =  steinlc; 

AMSAACrowlC [  ]  ; 
rcrowlc  =  unbiasedlc; 

l^AB 

AMPMSteinApproxk  =  ^  (AAslEjll  -  As,K/h|[j]] )  2  ; 

j=i 


-  1 


AMPMSteinApproxoo  =  (A*b IE j ]]  -  As,co,hIIj]] )  2  ; 

j=i 

AMPMSteinActual  =  ^  (Aab  IE  j  I  -  AS/K  [[jj )  2  ; 


3=1 

kAB 


v1  (  nab,  i  r 

AMSAACrowError  =  >  I  A*b  [[  j  ]] - I[jJ  ; 

3=1 

rMMEerrorlC  =  {AMSAACrowError, 

AMPMSteinApproxk,  AMPMSteinApproxoo,  AMPMSteinActual}; 


4.6.3  MLE  using  Two  Classifications. 

The  Mathematica  code  below  performs  the  projections  in  the  two  classification  case  using 
MLE. 
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check2  =  0 ; 

If  [Max  [NB/i]  >  1, 

I  nb  \ 

f  [x  ]  :  =  -  Log  [  1  +  x  T]  ; 

'  x  T  > 

/3mleoo  =  x  /  .  FindRoot  [f  [x]  ==  m,  {x,  10"3}]; 
(*  EQUATION  7.172,  MARTZ  &  WALLER.  *) 


If  [kB  > 


NB‘ 


Zj=l  (NB,i  I[j]l  -  1)  NB,  i  Ij  1 

check2  = 1; 

kB  NB,i  Ijl  -1 

g[x_]  := f  [x]  -  y1  y  - 

Z—l  Z_l  1  +  (- 

j=i  p=i  '  ne 


(^) 


/3mleK  =  x  /  .  FindRoot  [g  [x]  ==  m,  {x,  10"3}];, 
"No  solution  to  /3k." ],  "No  repeats."]; 
Stein2C  [/3mleoo,  /3mleK]  ; 
rstein2cmle  =  stein2c; 

AMSAACrow2C[] ; 

kB 

AMPMSteinApproxk  =  ^  (AB[[jl  -  -*s,K,hIIjI )  2  /* 

j=i 


AMPMSteinApproxoo  =  ^  (AB[[j]]  -  AS/00/h[Ij]l)  2  ; 

j=i 

kB^ 

AMPMSteinActual  =  (ABIjl  -  As,xljl)2; 


j=i 

kB 


AMSAACrowError 


■Z( 

j=i 


ABIjl  - 


NB,i 


Ijl 


)*■ 


rMLEerror  =  {AMSAACrowError, 

AMPMSteinApproxk,  AMPMSteinApproxoo,  AMPMSteinActual}; 


4.6.4  MLE  using  One  Classification. 

This  Mathematica  routine  reruns  the  projections  using  MLE  when  all  modes  are  treated  in  a 
unified  fashion. 
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check2  =0; 

If  [Max  [Nab, i ]  >  1/ 

/  Nab  \ 

f  [x  ]  :=  -  Log[l  +  xT]? 

'XT' 


fimleco  =  x  /  .  FindRoot  [f  [x]  ==  m2  ,  {x,  10  3  }  ]  ; 
(*  EQUATION  7.172,  MARTZ  &  WALLER.  *) 


If  [kis  > 


_ w _ 

Zjfl  (N*B.iEj]|  -1)  NAB.iljJ  ' 


check2  =  1; 

Nab,  i  I j  1-1 

1 

/  XTp  kAB 

j=l  p=l  '  Nab 


g[x_]  :  =  f  [x] 


-Z  Z 


/3mleK  =  x/.  FindRoot  [g  [x]  ==m2,  {x,  10"3}];, 
"No  solution  to  /3K .  "  ]  ,  "No  repeats."]; 
SteinlC  [/3mleoo,  £mleK] ; 
rsteinlcmle  =  steinlc; 

AMSAACrowlC [ ] ; 

AMPMSteinApproxk  =  (Aab lEjl  -  As,K,hI[j]] )  2 ; 

j=i 


^AB 

AMPMSteinApproxoo  =  ^  (AabHj]]  -  As#00#hIIj]l)  2; 

j=i 

^AB 

AMPMSteinActual  =  (Aab  II  j  H  -  As,k  II  jl )  2; 

j=i 


AMSAACrowError  = 


^AB 

Z( 

j=i 


2 


rMLEerrorlC  =  {AMSAACrowError, 

AMPMSteinApproxk,  AMPMSteinApproxoo,  AMPMSteinActual} 
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4.7  Simulation  Results. 


4.7.1  Storing  Results. 

During  one  execution  of  the  simulation,  the  necessary  data  is  generated,  and  four  different 
types  of  reliability  projections  are  calculated.  In  addition,  the  mean  square  error  is  examined. 
Since  the  simulation  can  be  replicated  numerous  times,  the  results  during  each  replication 
must  be  saved.  The  following  Mathematica  instructions  store  this  data. 

mtbf results  =  {}; 
rmtbf results  =  {}; 
errorresults  =  {}; 
mtbfresultslc =  {}; 
rmtbf resultslc =  {}; 
errorresultslc =  {}; 
surfaced  =  { } ; 

AppendTo  [surf  aced,  {Length  [Select  [tA/  i  ST&]],  m}  ]  ; 

(*  2  C  *) 

AppendTo [mtbf results. 

Join  [stein2cmle,  {stein2cmme[[3J  ,  stein2cmme|[4]] ,  crow2c[[5]]  }  ]  ]  ; 
AppendTo  [errorresults,  {MLEerror[[4]3 ,  MLEerror  [2]] , 

MLEerror[[3]] ,  MMEerror  [[2J  ,  MMEerror  J3]] ,  MLEerror  [[1J  }  ]  ; 

(*  1C  *) 

AppendTo [mtbfresultslc. 

Join  [steinlcmle,  {steinlcmme[[3]] ,  steinlcmme[[4]] ,  crowlcH5J  }  ]  ]  ; 
AppendTo  [errorresultslc,  {MLEerrorlC[[42  ,  MLEerrorlC|[2]] , 

MLEerrorlC[[3I] ,  MMEerrorlC[[2]] ,  MMEerrorlC[[3]| ,  MLEerrorlC[[l]]  }  ]  ; 
(*  RECLASSIFICATION  *) 

(*  2  C  *) 

AppendTo [rmtbf results.  Join [rstein2cmle, 

{rstein2cmme[[3]] ,  rstein2cmmeH4J  ,  rcrow2c[[5]]  }  ]  ]  ; 

(*  1C  *) 

AppendTo [rmtbf resultslc.  Join [rsteinlcmle, 

{rsteinlcmme|[3]] ,  rsteinlcmme[[4]] ,  rcrowlc[[5]]  }  ]  ]  ; 
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4.7.2  Displayed  Results. 

The  Mathematica  code  below  consists  of  print  statements,  which  display  the  data  shown  in 
Tables  7  through  1 1  below.  These  data  represent  the  MTBF  projections  in  the  various  cases 
previously  discussed.  Also,  these  projections  are  for  one  replication  of  the  simulation.  When 
replicating  the  simulation  numerous  times,  as  performed  in  the  study,  the  mean  squared  error, 
and  variance  in  the  projections  are  calculated  over  the  sequence  of  runs.  These  data  are  not 
provided  below  since  only  one  replication  is  examined. 

TableForm[Map  [NumberForm[#,  (4,  2),  NumberPadding  -»  {"",  "0"}]  &, 
mtbf results,  {2}], 

TableHeadings -»  {None,  {"Actual",  "Stein",  "MLE  K" ,  "  MLE  oo", 

"MME  K",  "MME  oo",  "A-C"}},  TableAlignments  -»  Right] 
TableFormfMap [NumberFormf#,  {4,  2},  NumberPadding -»  {"" ,  "0"}]  &, 
mtbf resultslc,  {2}], 

TableHeadings  -»  {None,  {"Actual",  "Stein",  "MLE  K",  "MLE  oo", 

"MME  K" ,  "MME  oo" ,  "A-C"}},  TableAlignments  -»  Right] 
TableForm[Map  [NumberForm[#,  {4,  2},  NumberPadding -»{"" ,  "0"}]  &, 
rmtbfresults,  {2}], 

TableHeadings  -»  {None,  {"Actual",  "Stein",  "MLE  K",  "MLE  oo", 

"MME  K",  "MME  co",  "A-C"}},  TableAlignments  Right] 
TableForm[Map  [NumberFormf#,  {4,  2},  NumberPadding  -»  {" ",  "0"}]  &, 
rmtbf resultslc,  {2}], 

TableHeadings  -*  {None,  {"Actual",  "Stein",  "MLE  K" ,  "MLE  oo", 

"MME  K",  "MME  oo",  "A-C"}},  TableAlignments  Right] 

The  structure  of  the  tables  below  are  equivalent.  That  is,  they  contain  the  same  columns,  in 
the  same  order.  The  first  two  columns  in  these  tables,  namely  "Actual"  and  "Stein",  are 
theoretical  MTBF  values  and  are  not  attainable  through  experience.  The  capability  of  obtain¬ 
ing  these  values  here  is  due  to  making  assumptions  regarding  the  distribution,  and  population 
parameters  of  failure  modes  in  addition  to  randomly  generating  data,  typical  to  that  collected 
in  a  developmental  test.  "Actual"  represents  the  actual  system  MTBF.  "Stein"  represents  the 
actual  MTBF  based  on  Stein  estimation.  "MLE  K"  and  "MME  K"  are  the  MTBF  projections 
based  on  MLE  and  MME,  respectively,  in  the  case  where  there  is  a  finite  number  of  failure 
modes.  "MLE  oo"  and  "MME  oo"  represent  the  projections  based  on  MLE  and  MME,  respec¬ 
tively,  in  the  case  where  there  is  an  infinite  number  of  failure  modes.  These  infinite  estimates 
are  more  commonly  used  since  there  are  typically  an  unknown,  but  very  large,  number  of 
failure  modes  associated  with  complex  systems.  The  MLE  K,  MLE  oo,  MME  K,  and  MME 
oo  estimates  are  all  projections  of  the  AMPM-Stein  model.  The  last  column  is  the  projection 
given  by  the  AMSAA-Crow  model,  labeled  "A-C." 
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Actual  stein  MLE  K  MLE  oo  MME  K  MME  co  A-C 

17.01  14.63  14.68  14.21  14.59  13.46  14.07 

Table  7.  MTBF  -  Two  Classifications. 

Actual  Stein  MLE  K  MLE  cn  MME  K  MME  co  A-C 

17.01  17.80  16.77  14.40  16.82  13.83  14.11 

Table  8.  MTBF  -  One  Classifications. 

Actual  stein  MLE  K  MLE  co  MME  K  MME  oc  A-C 

41.25  41.99  42.57  37.51  42.53  30.34  35.76 

Table  9.  MTBF  -  Two  Classifications  (Reclassified). 

Actual  stein  MLE  K  MLE  oo  MME  K  MME  co  A-C 

41.25  41.99  42.57  37.51  42.53  30.34  35.76 

Table  10.  MTBF  -  One  Classifications  (Reclassified). 

It  is  noted  that  Tables  9  and  10  are  identical.  In  this  replication  of  the  model,  6  A-modes  and 
10  B-modes  were  generated.  Since  all  6  A-modes  were  reclassified  to  B-modes,  the  data 
structures  utilized  between  the  two,  and  the  one  classification  cases  are  equivalent,  yielding 
the  same  projections.  That  is,  if  all  A-modes  generated  in  any  replication  of  the  model  were 
reclassified,  the  projections  between  the  classification  methods  would  be  equivalent  since  the 
two  classification  only  has  one  class  of  modes  -  the  B-modes.  This  is  due  to  the  fact  that 
there  are  no  A-modes  left  after  reclassification  to  divide  the  failure  modes  into  two  categories 
-  all  the  modes  are  B-modes  and  have  one  classification. 
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5.  RESULTS  AND  ANALYSIS. 


5.1  Results  using  Gamma  Failure  Rates. 

Simulations  were  run  in  Mathematica  to  investigate  the  accuracy  of  the  Stein 
MTBF  projections  MS(T )  s  (ps(T)Y] ,  and  assessed  MTBFs  for  the  AMPM-Stein  model 
based  on  MLE  and  MME  estimates  of  the  Stein  shrinkage  factor  0S .  This  was  done  for 

assessed  MTBFs  based  on  finite  a  number  of  modes,  k,  and  large  k  (i.e.  k  ->  oo).  The 
accuracy  of  the  procedures  were  investigated  for  two  mode  classifications,  and  where 
modes  are  only  differentiated  via  the  mode  FEFs  (referred  to  as  one  classification).  The 
accuracy  of  these  procedures  for  MTBF  assessment  were  compared  to  the  accuracy  of  the 
IEC  standard  for  reliability  projection  (the  AMSAA-Crow  model). 

The  simulation  consists  of  a  number  of  steps,  and  was  demonstrated  in  Section  4. 
A  summary  of  these  steps  include: 

1.  Specifying  various  inputs;  such  as,  specifying  a  distribution  to  randomly  draw 
mode  failure  rates  (i.e.  gamma,  Weibull  or  lognormal),  the  number  of  A- 
mode  failure  rates  to  generate,  the  number  of  B-mode  failure  rates  to 
generate,  the  length  of  the  simulated  test  phase,  and  the  number  of  tests  to 
replicate. 

2.  Generating  kA  and  kB  A-mode  and  B-mode  failure  rates,  respectively,  for  the 
selected  distribution.  The  same  distribution  was  used  for  generating  the  A- 
modes  and  B-modes. 

3.  Calculating  A-mode  and  B-mode  first  occurrence  times. 

4.  Generating  B-mode  fix  effectiveness  factors  from  a  beta  distribution  with 
shape  parameters  equal  to  19.2  and  4.8.  These  parameters  yield  a  mean  and 
coefficient  of  variation  of  0.8  and  0.1,  respectively.  The  A-mode  fix 
effectiveness  factors  are  set  equal  to  zero,  since  these  modes  are  not  fixed. 

5.  Calculating  a  sequence  of  failure  times  for  each  failure  mode. 

6.  Calculating  the  MTBF  projections  discussed  above  using  two  classifications 
and  one  classification  of  failure  modes. 

7.  Reclassifying  repeat  A-modes  to  B-modes.  The  associated  fix  effectiveness 
factors,  are  changed  from  zero  to  a  random  number  generated  by  the  beta 
distribution  discussed  in  step  4.  This  is  done  since  the  failure  modes  will  now 
be  addressed  by  corrective  action. 

8.  Recalculate  the  one  classification  projections  after  reclassification. 

The  presented  simulation  runs  perform  the  steps  above  for  a  test  phase  of  length  3,000 
hours.  This  process  is  replicated  1,000  times  (i.e.  1,000  tests  are  simulated).  The 
distribution  type,  as  well  as  the  simulated  number  of  A  and  B-modes,  and  average 
number  of  surfaced  A  and  B-modes  over  the  1,000  replications  are  shown  in  Table  11. 

Simulated  Surfaced  Distribution 

A-Modes  200  54  Gamma 

B-Modes  500  135  Gamma 

Table  11.  Simulated/Surfaced  Failure  Modes. 


57 


Table  1 1  shows  that  there  were  200  A-modes  and  500  B-modes  simulated  in  each  test. 
There  were  54  surfaced  A-modes  and  135  surfaced  B-modes  on  average  over  the  1,000 
tests.  The  failure  mode  rates  were  simulated  from  a  gamma  distribution  whose 
parameters  are  shown  in  Table  12. 


A-Modes 

Shape  -  a  0 . 6667 

Scale  -  /3  0.0002 


B-Modes 
0. 6667 
0.0002 


Table  12.  Gamma  Parameters. 


These  parameter  values  were  held  constant  for  the  indicated  number  of  replications. 
However,  new  sets  of  initial  mode  failure  rates,  and  FEFs  were  generated  for  each 
replication. 

For  every  replication,  a  simulated  failure  history  was  generated  for  each  of  the 
failure  modes  over  the  specified  test  period  (T  =  3,000  hours  for  the  displayed  results). 
At  the  end  of  the  test,  the  estimated  surfaced  B-mode  failure  rates  for  a  procedure  were 
reduced  by  their  associated  mode  FEFs  to  obtain  the  assessed  MTBF  value.  Tables  13 
through  15  below  display  the  actual  MTBF  and  assessed  MTBF  values  for  several  cases. 
"Actual"  represents  the  actual  system  MTBF.  "Stein"  represents  the  actual  MTBF  based 
on  Stein  estimation.  "MLE  K"  and  "MME  K"  are  the  MTBF  projections  based  on  MLE 
and  MME,  respectively,  in  the  case  where  there  is  a  finite  number  of  failure  modes. 
"MLE  oo"  and  "MME  oo"  represent  the  projections  based  on  MLE  and  MME, 
respectively,  in  the  case  where  there  is  an  infinite  number  of  failure  modes.  These 
infinite  estimates  are  more  commonly  used  since  there  are  typically  an  unknown,  but 
very  large,  number  of  failure  modes  associated  with  complex  systems.  The  MLE  K, 
MLE  oo,  MME  K,  and  MME  oo  estimates  are  all  projections  of  the  AMPM-Stein  model. 
The  last  column  is  the  projection  given  by  the  AMSAA-Crow  model,  labeled  "A-C." 

1 .  Assuming  an  inherent  set  of  A  and  B-modes.  The  versions  of  the  Stein,  and 
AMPM-Stein,  that  assume  such  a  mode  split,  and  the  AMSAA-Crow  model 
were  used  to  generate  the  assessed  MTBFs  displayed  in  the  table  labeled  two 
classifications. 

Actual  Stein  M1E  K  MLE  a  MME  K  MME  to  A-C 

MTBF  15.58  15.61  15.58  15.37  15.54  15.01  14.43 

Table  13.  MTBF  Projections  -  Two  Classifications. 

2.  One  classification  case,  i.e.  procedures  that  only  distinguish  between  A  and 
B-modes  for  estimation  purposes  by  FEFs.  The  AMSAA-Crow  as  presented 
in  Crow  (1982)  and  Ellner,  et  al.  (1995)  is  not  designed  to  handle  this  case. 
However,  a  one  classification  version  of  this  method  can  be  derived.  To 
implement  this  variant,  all  modes  were  treated  as  B-modes  for  estimation  with 
di  =  0  for  the  generated  A-modes. 
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Actual  Stein  MLE  K  MLE  co  MME  K  MME  oo  A-C 

MTBF  15.58  15.60  15.56  15.36  15.53  15.01  14.43 

Table  14.  MTBF  Projections  -  One  Classification. 

3.  Reclassification  using  one  mode  classification. 

Actual  Stein  MLE  K  MLE  co  MME  K  MME  co  A-C  I 

MTBF  17.02  17.03  17.00  16.93  16.95  16.41  16.23  I 

Table  15.  MTBF  Projections  -  One  Classification  after  Reclassification  of  A-modes. 

For  the  reclassification  case,  each  generated  A-mode  was  reclassified  to  a  B- 
mode  if  one  or  more  repeat  failures  of  the  mode  occurred  during  the  simulated  test.  The 
averages  for  the  actual  and  assessed  MTBFs  are  displayed  in  tables  for  the  Stein, 
AMPM-Stein  approximations,  and  the  AMSAA-Crow  model.  The  appropriate  variant  of 
the  Stein  and  AMPM-Stein  approximation  for  the  one  classification  case  are  applied  to 
obtain  the  assessed  MTBFs  before  and  after  reclassification.  The  theory  on  which  the 
two  classification  variants  of  these  methods  are  based  do  not  apply  to  the  reclassification 
problem. 

Table  15  displays  averages  of  the  actual  and  assessed  mitigated  system  MTBFs 
after  reclassification  of  A-modes  for  one  classification  of  failure  modes.  The 
assessments  provided  by  the  Stein  and  AMPM-Stein  approximations  utilized  the  version 
of  these  methods  that  distinguish  between  A  and  B-modes  for  estimation  purposes  only 
through  their  assigned  FEFs.  The  version  of  the  AMSAA-Crow  method  applied  for 
Table  14  was  used  to  obtain  the  A-C  entries  in  Table  15.  A  theoretical  underpinning  that 
allows  a  unified  failure  mode  treatment  is  necessary  to  support  assessment  of  the  MTBF 
after  mode  reclassification. 

Tables  13  through  15  above  display  the  average  actual  and  assessed  mitigated 
system  MTBF  values  over  the  1,000  replications  for  each  of  the  cases  described,  which  is 
the  first  accuracy  measure  examined.  Tables  16  and  17  below  display  the  sample 
variance,  over  all  1,000  replications,  of  the  actual  and  assessed  MTBFs  before 
reclassification  of  A-modes,  for  two  classifications  and  one  classification,  respectively. 


Actual  Stein  MLE  K  MLE  oo  MME  K  MME  oo  A-C 

VAR  0.55  1.34  1.33  1.31  1.38  1.29  1.32 


Table  16.  MTBF  Variance  -  Two  Classifications. 


Actual  Stein  MLE  K  MLE  co  MME  K  MME  oo  A-C 

VAR  0.55  1.20  1.08  1.10  1.12  1.11  1.21 

Table  17.  MTBF  Variance  -  One  Classifications. 

From  tables  16  and  17  we  can  see  that  there  is  little  change  in  the  variance  in  the 
MTBF  for  the  assessments.  Note  that  for  each  assessment  procedure,  a  portion  of  the 
sample  variance  for  the  estimated  MTBFs  is  due  to  the  variation  in  the  actual  mitigated 
MTBFs. 
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A  third  accuracy  indicator  is  the  average,  over  the  1 ,000  replications,  of  the  sum 

k 

of  squared  errors  -  A,  )2  for  the  one  classification  case  and  ]T(T“  -T,)2  for  the 

1=1  ieB 

two  classification  case,  where  A"  denotes  the  assessed  mode  initial  failure  rate  for  a 
given  method.  For  comparison  purposes,  the  table  displays  the  average  of  the  sum  of 
squared  errors  (A,. -/I,)2,  denoted  “Standard,”  for  the  unadjusted  estimates  At.  Recall 

that  At  =  0  for  i  e  obs  . 

Tables  18  and  19  show  the  mean  square  error  (MSE)  in  the  MTBF  before 
reclassification  of  A-modes,  for  two  classifications  and  one  classification,  respectively. 

Stein  MLE  K  MLE  <=  MME  K  MME  a>  Standard 

MSE  0.00000831  0.00000845  0.00001121  0.00000847  0.00001120  0.00002210 

Table  18.  MSE  -  Two  Classifications. 


Stein  MLE  K  MLE  OO  MME  K  MME  co  Standard 

MSE  0 . 00001184  0.00001178  0.00001566  0.00001180  0.00001563  0.00003097 

Table  19.  MSE  -  One  Classification. 

The  average  of  these  unadjusted  squared  errors  (the  column  titled  “Standard”),  is  large 
compared  to  the  Stein  and  AMPM-Stein  procedures.  This  is  an  indication  that  one 

should  not  use  the  reciprocal  of  I0-4H  -  f,+  Ed  -di)Ai  to  estimate  the 

ieobs  ieobs(B) 

mitigated  MTBF  for  the  one  or  two  classification  cases. 

The  simulation  accuracy  results,  based  on  the  absolute  error  between  the  actual 
MTBF  and  the  assessed  MTBF,  indicate  the  Stein  and  AMPM-Stein  approximations 
compare  favorably  to  the  AMSAA-Crow  (A-C)  method 


MLE  co  A-C  MME  03  A-C  MLE  co  MME  03 

73.5  26.5  75.2  24.8  64.6  35.4 

Figure  4.  Distribution  of  Most  Accurate  Projection  -  Two  Classifications. 

Figure  4  shows  three  pie  charts.  The  pie  charts  are  one-on-one  comparisons  between  two 
estimation  methods.  For  example,  the  pie  chart  on  the  left  side  of  Figure  1  compares  the 
MTBF  accuracy  between  the  AMPM-Stein  MLE  (with  an  infinite  number  of  modes)  to 
that  of  the  AMSAA-Crow  model.  The  distribution  is  shown  below  the  pie  chart.  For  the 
pie  chart  on  the  left,  the  AMPM-Stein  MLE  (with  an  infinite  number  of  modes)  provided 
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a  more  accurate  MTBF  projection  than  that  for  the  AMSAA-Crow  model  in  73.5%  of  the 
1,000  tests  that  were  replicated. 

The  AMPM-Stein  procedures  for  finite  k  and  large  k  (i.e.  k  -»  oo )  based  on  the 
MLE  and  MME  shrinkage  estimators  produced  MTBF  assessments  that  were  close  to 
each  other.  In  practice,  the  number  of  modes,  k,  is  not  known  and  could  be  difficult  to 
estimate.  However,  these  results  (and  underlying  theory)  indicate  that  for  complex 
systems,  one  does  not  need  to  assess  k.  The  displayed  simulation  results  also  indicate 
that  the  AMPM-Stein  assessments  from  the  simple  closed  form  MME  estimates  are 
comparable  in  accuracy  to  the  MTBF  assessments  based  on  the  more  computationally 
intensive  MLE  estimates. 

For  the  displayed  simulation  results,  the  accuracy  of  the  assessed  MTBFs  for  the 
Stein  and  AMPM-Stein  procedures  for  one  classification  were  comparable  to  the 
achieved  accuracy  of  the  corresponding  procedures  that  address  the  two  classification 
case.  The  same  is  true  for  the  MTBF  assessments  after  reclassification  with  respect  to 
the  one  and  two  classification  procedures. 

5.2  Results  using  Weibull  and  Lognormal  Failure  Rates. 

The  same  analysis  as  above  was  performed  in  two  additional  cases.  The  first 
generates  failure  rates  from  a  Weibull  distribution,  the  second  from  a  lognormal.  The 
means  and  variances  were  chosen  to  be  the  same  as  for  the  gamma  distribution.  This  was 
done  to  examine  the  impact  of  violating  the  assumption  that  the  mode  failure  rates  are  a 
realization  of  a  random  sample  from  a  gamma  distribution.  The  associated  tables  are 
shown  for  the  Weibull  and  lognormal  runs  in  Appendix  A  and  Appendix  B,  respectively. 
Even  though  the  AMPM-Stein  MLE  and  MME  estimation  procedures  for  the  unknown 
Stein  parameters  assume  the  Xi  are  realizations  from  a  gamma  distribution,  all  the 
comments  for  the  previous  tables  concerning  accuracy  still  apply  for  the  Weibull  case. 
Comparable  results  were  also  attained  when  the  Xl  were  generated  from  a  lognormal 
distribution.  This  perhaps  indicates  that  the  true  MTBF  and  AMPM-Stein  assessed 
MTBFs  are  not  strongly  affected  by  the  tails  of  the  distribution  of  mode  failure  rates. 
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APPENDIX  A  -  WEIBULL  RESULTS. 


Table  20.  Simulated/Surfaced  Failure  Modes. 


Table  21.  Weibull  Parameters. 


Table  22.  MTBF  Projections  -  Two  Classifications. 


Table  23.  MTBF  Projections  -  One  Classification. 


Table  24.  MTBF  Projections  -  One  Classification  after  Reclassification  of  A-modes. 


Table  25.  MTBF  Variance  -  Two  Classifications. 


Table  26  MTBF  Variance  -  One  Classifications. 


Stein  MLE  K  MLE  co  MME  K  MME  ro  Standard 

MSE  0.00000793  0.00000808  0.00001101  0.00000810  0.00001100  0.00002220 

Table  27.  MSE  -  Two  Classifications. 

Stein  MLE  K  MLE  co  MME  K  MME  co  Standard 

MSE  0.00001109  0.00001124  0.00001535  0.00001126  0.00001533  0.00003108 


Table  28.  MSE  -  One  Classification. 


MLE  oo  A-C  MME  co  A-C  MLE  co  MME  a> 

73.2  26.8  72.4  27.6  60.5  39.5 

Figure  5.  Distribution  of  Most  Accurate  Projection  -  Two  Classifications. 
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APPENDIX  B  -  LOGNORMAL  RESULTS 


Table  29.  Simulated/Surfaced  Failure  Modes. 


Table  30.  Lognormal  Parameters. 


Actual 

Stein 

MLE  K 

MLE  oo 

MME  K 

MME  co 

A-C 

MTBF 

15.02 

15. 64 

15.2  9 

14. 98 

15.57 

14.97 

14.07 

Table  31.  MTBF  Projections  -  Two  Classifications. 


Actual 

Stein 

MLE  K 

MLE  co 

MME  K 

MME  co 

A-C 

MTBF 

15.02 

15. 63 

15.27 

14 . 96 

15.5  6 

14.97 

14.07 

Table  32.  MTBF  Projections  -  One  Classification. 


Actual 

MTBF  16.22 

Stein 

16.  94 

MLE  K 

16.44 

MLE  co 

16.23 

MME  K 

16.87 

MME  co 

16.25 

A-C 

15.61 

Table  33.  MTBF  Projections  - 

One  Classification  after  Reclassification  of  A-modes. 

Actual 

Stein 

MLE  K 

MLE  co 

MME  K 

MME  co 

A-C 

VAR  0.45 

1.40 

1.16 

1.13 

1.56 

1.39 

1.13 

Table  34.  MTBF  Variance  -  Two  Classifications. 


Actual 

Stein 

MLE  K 

MLE  oo 

MME  K 

MME  CD 

> 

1 

o 

VAR 

0.45 

1.12 

0. 93 

0.94 

1.20 

1.14 

1.05  | 

Table  35.  MTBF  Variance  -  One  Classifications. 


MSE 

Stein 

0.00000822 

MLE  K 

0.00000844 

MLE  oj 

0.00001118 

MME  K 

0.00000841 

MME  cd 

0.00001119 

Standard 

0.00002234 

Table  36. 

MSE  -  Two  Classifications. 

Stein 

MLE  K 

MLE  os 

MME  K 

MME  co 

Standard  1 

MSE 

0.00001153 

0.00001178 

0.00001561 

0.00001173 

0.00001562 

0.00003117  I 

Table  37.  MSE  -  One  Classification. 


MLE  co  A-C  MME  co  A-C  MLE  co  MME  co 

67.7  32.3  66.6  33.4  59.1  40.9 

Figure  6.  Distribution  of  Most  Accurate  Projection  -  Two  Classifications. 
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APPENDIX  C  -  DERIVATION  OF  THE  STEIN  SHRINKAGE  FACTOR. 


The  Stein  shrinkage  factor,  6S ,  is  the  value  of  6  e  [0,1]  that  minimizes  the  sum  of  expected 
squared  error  loss  between  the  actual  mode  failure  rates,  denoted  by  A(.  for  i  =  1,2,..., k , 
and  the  Stein  estimates  of/1,. ,  defined 


K 

Z4 


j= i 


A^ds-Al+(l-0s) 

K 

To  find  0S  we  shall  first  calculate  the  unique  value,  <90,  such  that 


±El 

dB 


1=1 


=  0 


(1) 


(2) 


The  unique  value,  60 ,  will  be  shown  to  be  the  Stein  shrinkage  factor.  To  derive  60  one 


1.  E 

.4 

2.  4 

Z\ 

(  *  ^ 

2“ 

3.  E 

& 

4.  E 

14 

W=i  > 

5.  E 


VZ4 

H 


i=i 


where  is  the  MLE  of/l(. ,  which  is  given  by, 


i.  44 


-  N- 
A.  =  — 

'  r 


Since  TV,-  ~  Poz^T],  the  expected  value  of  (3)  is, 

Therefore  2,  is  an  unbiased  estimate  of  2(. . 

2.  4?]* 


6.  e[X;  J 


g.  £4?] 

/=! 


(3) 


(4) 


The  variance  of  i(.  is, 


From  (4)  and  (5),  one  can  see  that, 


73 


k 

where  X  =  ^Xj . 
>1 
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ft  ^ 

Since  Xi  and  S4  are  not  independent  random  variables,  their  product  is  rewritten  as, 

M 

k  ^  ^  k 

i,  -Y^ = A  +%  ’ which  §ives’ 


a 

v2>, 


a. 

ft  ft  ft« 

^i'Y^J  +^i 


ft  ^ 

Since  and  are  independent  random  variables,  by  using  (4)  and  (6),  (12) 


becomes, 


*  / ; 

H  V  ^ 

j*i 


k  2 
v5X+— 


6.  j?|3?J. 

From  (7)  one  can  see  that, 


ft  ^  ^  * 


V=e'a'+29(i-e) — e — +(i-t)!A>'  ^  ^ 

k  k 

Taking  the  expected  value  of  (14)  gives, 

\ir±X ,1  j 

e\X2]=02 -e[X2]+ 20(1-0) -E  - J- —  +(l-6>)2  •— L  -_2 

k  k 


By  utilizing  (6),  (13),  and  (1 1),  (15)  becomes, 

f  k  3  ’N 

/  x  vi>/+— 

4+^?]+2ea-«) — ^ — -  +a-9) 


^  ,  -]2 


2  U 


1.  £4  ■!$,}. 


From  (8),  one  can  see  that, 
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(17) 


1=1 


i=l 


where  A  =  . 

M 


8.  J. 

1=1 

Summing  (16)  over  i  =  \,2,...,k  yields. 


*  r~  1  (  7  k 

v 1  i'=l  / 


i=i 


+  20(1-0)' 


/  j  > 

A2+- 
_ T 

k 

v  y 


+  (l-0)2 


(  ;  \ 

^  +  A2 

U  J 


Evaluating  £" 


/=! 


Given  the  results  above,  one  can  now  evaluate  E 


£<y-y>! 


i=i 


=  £ 


(18) 


£0?- 22,1, +  2?) 


1=1 


-  X(4?]- 2A<Ebb  *?)=  £4?]-  v?fc]+  t,A‘  (19) 

i-\  i- 1  i=l  /=1 


By  utilizing  (18)  and  (17),  the  right-hand  side  of  (19)  becomes, 


02- 


(7  *  ^ 

vy  /=i  y 


+  20(1-0) 


_ T_ 

k 

\  J 


+  (1-0) 


-  +  A2^ 

2  _ y 


-2f0.tA2+(i-0)4]+tA2 

\  1=1  *  y  i=l 


After  the  algebraic  manipulations, 


e7  £  42  -  20^  a?  +  J  Aj  =  (1  -  ey  £  a, 2 


1=1  1=1 


and 

20(1 -6>)| 

(20)  is  expressed  as, 


v  *  y 


+  (i-0): 


v  *  y 


-2(1  -6) 


\  k  J 


=  d  -ey 


\  k  j 


\T)  w  \*T) 


Vt  ^ 


Thus,  E 


£(^-^)2 


=  /(0)  is  a  quadratic  polynomial  with  respect  to  0. 


(20) 

(21) 

(22) 

(23) 
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Evaluating  —E 


=  0. 


(1\  k  (  2  \  , 

f'(6)  =  26  ±  -(2-20)^ +(2-40)  ±-  -(2-2 G)\ 

\T )  tr  U?7 


(24) 


/,(6’o)  =  0  implies, 
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+  2^X^?-4«„ 


/=! 


f— ' 

Ur, 


+  2ft 


=  2S^f  -2 


y  3 


j 


i= 1 


V^y 


+  2 


/4 


(25) 


v  J 

k  ^  _  k  , 

After  algebraic  manipulation  of  (25),  and  using  the  fact  that  V(ft  -A)2  =  V  A. - , 

X-J  ^ 


i=i 


/=! 


2A 


where  A  =  — — ,  the  expected  sum  of  squared  error  optimality  criterion  is  given  by, 
k 


ft  = 


j=i 


°  ^ -iVlw-i)2 


(26) 


i=i 


From  (26)  one  can  see  that  ft  €  (0,1) .  The  assurance  that  ft  is  a  minimum,  and  not  a 

maximum,  results  from  the  fact  that  the  polynomial  coefficient  of  02  in  (23)  is  positive. 

k  ~  \\  r* 

That  is,  V(/l,  -A)2  +—  1 —  >0.  Since  ft  €(0,1)  and  minimizes  E  V - ft)z  I,  we 
m  A  k)  Ltf 

have  ft  =  ft . 
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No.  Copies 
8 

1 


Organization 

Director 

U.S.  Army  Materiel  Systems  Analysis  Activity 
ATTN:  AMSRD-AMS-LA  (8  cys) 

Aberdeen  Proving  Ground,  MD  21005-5071 

Defense  Technical  Information  Center 
ATTN:  Raji  Bezwada  (OCA) 

8725  John  J.  Kingman  Road,  Suite  0944 
Fort  Belvoir,  VA  22060-6218 


REPLY  TO 
ATTENTION  OF 


DEPARTMENT  OF  THE  ARMY 

US  ARMY  RESEARCH,  DEVELOPMENT  AND  ENGINEERING  COMMAND 
ARMY  MATERIEL  SYSTEMS  ANALYSIS  ACTIVITY 
392  HOPKINS  ROAD 

ABERDEEN  PROVING  GROUND,  MARYLAND  21005-5071 


AMSRD-AMS-B 


18  July  2005 


MEMORANDUM  FOR  Defense  Technical  Information  Center  (DTIC-OQ/  Larry  Downing), 
8725  John  J.  Kingman  Road,  Suite  0944,  Fort  Belvoir,  VA  22060-6218 

SUBJECT:  Request  for  Change  in  Distribution  Statement  of  AMSAA  Technical  Report 


1.  Reference  email  between  Mrs.  Marian  Brooks,  this  office,  and  Mr.  Lawrence  Downing, 

DTIC,  1 1  March  2005,  subject  as  above. 

2.  AMSAA  submitted  Technical  Report  No.  TR-751,  AMSAA  Maturity  Projection  Model 
Based  on  Stein  Estimation,  dated  July  2004  to  DTIC  in  September  2004  with  Distribution 
Statement  B.  The  AD  Number  assigned  by  DTIC  to  this  report  is  ADB302442.  This  document 
has  since  been  reviewed  and  a  new  distribution  statement  was  applied.  Distribution  Statement  A, 
Approved  for  Public  Release;  Distribution  is  Unlimited  should  be  now  be  placed  on  this  report. 

3.  POC  for  this  action  is  Ms.  Marian  Brooks,  DSN  298-4661 . 

FOR  THE  DIRECTOR: 


4r  (~  Patricia  J.  Cook 

Chief,  Security  &  Operational  Support  Division 


